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Abstract 



In this topical review we discuss the nature of the low-temperature phase in both infinite- 
ranged and short-ranged spin glasses. We analyze the meaning of pure states in spin glasses, 
and distinguish between physical, or "observable", states and (probably) unphysical, "invisi- 
ble" states. We review replica symmetry breaking, and describe what it would mean in short- 
ranged spin glasses. We introduce the notion of thermodynamic chaos, which leads to the 
metastate construct. We apply these tools to short-ranged spin glasses, and conclude that 
replica symmetry breaking, in any form, cannot describe the low-temperature spin glass phase 
in any finite dimension. We then discuss the remaining possible scenarios that could describe 
the low-temperature phase, and the differences they exhibit in some of their physical prop- 
erties — in particular, the interfaces that separate them. We also present rigorous results on 
metastable states and discuss their connection to thermodynamic states. Finally, we discuss 
some of the differences between the statistical mechanics of homogeneous systems and those 
with quenched disorder and frustration. 
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Figure 1: A rough sketch of the classical ground states of: (a) a crystal; (b) a glass; (c) a ferro- 
magnet; (d) an Ising spin glass. In (a) and (b) the dots represent atoms; in (c) and (d) the arrows 
represent localized magnetic moments. (In the case of (b), it is more accurate to describe the 
configuration as a frozen metastable state.) 

1 Introduction 

Despite decades of intensive investigation, the statistical mechanics of systems with both quenched 
disorder and frustration remains an open problem. Among such systems, the spin glass is arguably 
the prototype, and inarguably the most studied. 

Spin glasses are systems in which competition between ferromagnetic and antiferromagnetic 
interactions among localized magnetic moments (or more colloquially, "spins") leads to a magneti- 
cally disordered state (Fig.[T]). The prime example of a metallic spin glass is a dilute magnetic alloy, 
in which a magnetic impurity (typically Fe or Mn) is randomly diluted within a nonmagnetic metal- 
lic host, typically a noble metal. The competition between ferromagnetic and antiferromagnetic 
interactions arises in these systems from the RKKY interactions lUl |21 El between the localized 
spins, mediated by the conduction electrons. 

But many other types of spin glass, with different microscopic mechanisms for their "spin 
glass-like" behavior, exist. Certain insulators, in which low concentrations of magnetic impuri- 
ties are randomly substituted for nonmagnetic atoms, also display spin glass behavior. A well- 
known example [4| is Eu^jSri^^S, with x roughly between .1 and .5, where the competition arises 
largely from nearest-neighbor ferromagnetic and next-nearest-neighbor antiferromagnetic interac- 
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Figure 2: Low-field magnetic susceptibility xiT) in AuFe alloys at varying concentrations of iron 
impurity. From Cannella and Mydosh [|61|. 

tions. There are many other materials that exhibit spin glass behavior, both metallic and insulating, 
crystalline and amorphous. They can display Ising, planar, or Heisenberg behavior, and come in 
both classical and quantum varieties. In this review we consider only classical spin glasses ||5 1. 

What are the main experimental features of spin glasses? One is the presence of a cusp in 
the low-field ac susceptibility (Fig. 2), as first observed in AuFe alloys by Cannella and Mydosh 
ll6l . This cusp becomes progressively rounded as the external magnetic field increases 0. The 
specific heat, however, rather than showing a similar singularity, typically displays a broad maxi- 
mum (Fig. 3) at temperatures somewhat higher than the "freezing temperature" Ty defined via the 
susceptibility peak (see, e.g., [|8J). 

Probes of the low-temperature magnetic structure using neutron scattering, Mossbauer studies, 
NMR and other techniques confirm the absence of long-range spatial order coupled with the pres- 
ence of temporal order insofar as the spin orientations appear to be frozen on the timescale of the 
experiment. An extensive description of these and related experiments are presented in the review 
article by Binder and Young . 

Spin glasses are also characterized by a host of irreversible and non-equilibrium behaviors, 
including remanence, hysteresis, anomalously slow relaxation, aging and related phenomena. Be- 
cause this review will focus on static equilibrium behavior, these topics will not be treated here, but 
it is important to note that explaining these phenomena are essential to any deeper understanding 
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Figure 3: Magnetic specific heat of Cm of CmMii at 1.2% manganese impurity. The arrow indicates 
the freezing temperature Tf as discussed in the text. From Wenger and Keesom ||8J. 

of spin glasses. For reviews, see llQl fTOlfTTlfTll . 

The quest to attain a theoretical understanding of spin glasses has followed a tortuous path, 
and to this day many of the most basic and fundamental issues remain unresolved. An extensive 
discussion of theoretical ideas can be found in a number of reviews ^ [TOl [TTl [131 ISl El [T6ll . 
The good news is that research into spin glasses has uncovered a variety of novel and sometimes 
stunning concepts; the bad news is that it is not clear how many of these apply to real spin glasses 
themselves. In this review we will explore some of these issues, in particular the nature of ordering 
and broken symmetry in the putative spin glass phase. 

As a first step, one needs to capture mathematically the absence of orientational spin ordering 
in space with the presence of frozenness, or order in time. This was achieved early on by Edwards 
and Anderson (EA) [[T71, who noted that a low temperature pure phase of spin glasses should be 
characterized by a vanishing magnetization per spin 

M = lim {^^) (1) 

accompanied by a nonvanishing "EA order parameter" (as it is now called) 

qEA = lim -r^ i^^y (2) 

where cr^ is the spin at site x, is a cube of side L centered at the origin, and (■) denotes a thermal 
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average. 

However, it was later discovered that, while the EA order parameter qea plays a central role in 
describing the spin glass phase, it is insufficient to describe the low temperature ordering — at least 
in a mean-field version of the problem. In the following sections we will explain this statement, 
explore the relationship between the mean-field spin glass problem and its short-ranged version, 
and discuss some new and general insights and tools that may turn out to be useful in unraveling 
the complexities of the statistical mechanics of inhomogeneous systems. 

2 A Brief History of Early Theoretical Developments 

Questions regarding spin glass behavior fall naturally into two classes: the first pertains to proper- 
ties of a system in thermal equilibrium, and the second to those related to nonequilibrium dynam- 
ics. It is still not certain whether spin glasses possess nontrivial equilibrium properties, but their 
nonequilibrium ones surely are. As already noted, throughout this review we will focus primarily 
on spin glasses in thermal equilibrium. 

Perhaps the most fundamental question that can be asked is whether there exists such a thing 
as a true, thermodynamic spin glass phase; that is, is there a sharp phase transition from the high- 
temperature paramagnetic state to a low-temperature spin glass state in zero external magnetic 
field? Of course, this is presumably the simplest transition that could in principle occur; one 
could also ask about field-induced transitions, ferromagnetic to spin glass transitions, and others. 
But given that all of these questions remain open, we'll confine our attention here to the simplest 
of these. And even here, although experimental and numerical studies have tended to favor an 
affirmative answer, the issue is by no means resolved. 

2.1 The Edwards- Anderson Hamiltonian 

In order to proceed, we need a specific model to study. The majority of theoretical investigations 
begin with a Hamiltonian proposed by Edwards and Anderson iflTI : 

7i = - ^ Jxy(^x(^y - h^a^ , (3) 

<x,y> X 

where (to keep things as general as possible) x is a site in a d-dimensional cubic lattice, is the 
spin at site x, the spin couplings J^y are independent, identically distributed random variables, h 
is an external magnetic field, and the first sum is over nearest neighbor sites only. We will usually 
take the spins to be Ising variables, i.e., ax = ±1. Throughout most of the paper we will choose 
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h = and the spin couplings J^y to be symmetrically distributed about zero; as a result, the EA 
Hamiltonian in Eq. ^ has global spin inversion symmetry. 

Popular choices for the distribution of the couplings Jxy are bimodal and Gaussian. Most of 
what we discuss below will be independent of which of these is chosen, but for specificity (and to 
avoid accidental degeneracies when discussing ground states) we will choose the couplings from 
a Gaussian distribution with mean zero and variance one. It is important to note the the disorder is 
quenched: once chosen, the couplings are fixed for all time. We denote by J" a particular realization 
of the couplings, corresponding physically to a specific spin glass sample. Proper averaging over 
quenched disorder is done on extensive quantities only ifTSl . i.e., at the level of log Z rather than 
Z, where Z is the partition function. 

Of course, the EA Hamiltonian looks nothing like a faithful microscopic description of spin 
interactions in a dilute magnetic alloy, or an insulator like Eu^Sri_a.S — and because the statistical 
mechanics of the EA Hamiltonian remain to be worked out, a direct comparison with experiment 
remains elusive. However, a central assertion of ifTTI is that the essential physics of spin glasses is 
the competition between quenched ferromagnetic and antiferromagnetic interactions, regardless of 
microscopic details; and so the EA Hamiltonian remains the usual launching point for theoretical 
analyses of real spin glasses. 

2.1.1 Frustration 

A striking feature of random-bond models like the EA spin glass is the presence of frustration, in 
this case meaning the inability of any spin configuration to simultaneously satisfy all couplings. It 
is easily verified that, in any dimension larger than one, all of the spins along any closed circuit C 
in the edge lattice cannot be simultaneously satisfied if 

n J^y<0- (4) 

<x,y>eC 

The definition of frustration given above was first suggested by Toulouse ifT^ . A different for- 
mulation due to Anderson lEUI received less notice when it was first proposed, but its underlying 
ideas may prove useful in more recent spin glass research. The basic notion is that frustration man- 
ifests itself as free energy fluctuations (e.g., with a change in boundary conditions from periodic to 
antiperiodic) that scale as the square root of the surface area of a typical sample. 

Hence the spin glass is characterized by both quenched disorder and frustration. The presence 
of frustration, leading to a complicated geometry of entangled frustration contours, suggests the 
possibility that spin glasses, in at least some dimensions, may possess multiple infinite-volume 
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ground or pure states unrelated by any simple symmetry transformation. We will return to this 
question later. We note here, though, that there exists at least one (unrealistic) spin glass model 
where the number of ground states can be computed in all finite dimensions. This is the highly 
disordered model of the authors ll2ni22l (see also |l23||) in which the coupling magnitudes scale 
nonlinearly with the volume (and so are no longer distributed independently of the volume, al- 
though they remain independent and identically distributed for each volume). It can be shown 
ll2Tll22l that there exists a transition in ground state multiplicity in this model: below eight dimen- 
sions, it has only a single (globally spin reversed) pair of ground states, while above eight it has 
uncountably many ground state pairs. Interestingly, the high-dimensional ground state multiplicity 
can be shown to be unaffected by the presence of frustration, although frustration still plays an 
interesting role: it leads to the appearance of chaotic size dependence, to be discussed in Sec.|5] 

2.2 Mean Field Theory, the Sherrington-Kirkpatrick Model, and the Parisi 
Solution 

Mean field models often provide a useful first step towards understanding the low-temperature 
phase of a condensed matter system; in the case of spin glasses, the usual procedure seems to have 
taken a particularly interesting twist. The mean field theory of spin glasses turns out to be far more 
intricate than those of most homogeneous systems, and as a result several different approaches 
have been tried. Also noteworthy are even simpler, soluble spin glass-like models, in particular the 
random energy model of Derrida ll24ll . However, here we will confine ourselves to a discussion of 
the Sherrington-Kirkpatrick (SK) model [25|, an infinite-ranged version of the EA model in which 
mean field theory is presumably exact. 

The SK Hamiltonian for a system of spins is (as usual, we take external field to be zero): 

l<i<j<N 

where we again take the spins to be Ising and choose the (independent, identically distributed) 
couplings Jij from a Gaussian distribution with zero mean and variance one; the latter rescaling 
ensures a sensible thermodynamic limit for free energy per spin and other thermodynamic quanti- 
ties. 

It was shown in lE51l that this model has a sharp phase transition at Tc = 1. At this temperature 
the static susceptibility has a cusp — but so does the specific heat. 

SK solved for the low-temperature spin glass phase, using the EA order parameter to describe 
the broken symmetry. However, their solution was unstable ll25l : in particular, the entropy was 
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found to become negative at sufficiently low temperature. 

The following four years saw intensive efforts to solve for the low-temperature phase of the 
SK model. Of particular note is the direct mean field approach of Thouless, Anderson, and Palmer 
ll26l . who pointed out the necessity of including the Onsager reaction field term, and the paper by 
de Almeida and Thouless ll27ll . who studied the stability of the SK solution in the T-h plane and 
calculated the boundary between the regions where a single (i.e., paramagnetic) phase is stable and 
the region where the low-temperature phase resides. One important question that remains open to 
this day is whether such an "AT line" exists for more realistic models (see Sec. I10.3l for further 
discussion). 

We will mainly focus, however, on what is today believed to be the correct solution for the low- 
temperature phase of the SK model. In a series of papers, Parisi and collaborators lESlE^ll^lTTl 
proposed, and worked out the consequences of, an extraordinary ansatz for the nature of this phase. 
Following the mathematical procedures underlying the solution, it came to be known as replica 
symmetry breaking (RSB). 

We will not review those mathematical procedures here; they are worked out in detail in sev- 
eral review articles and books (see, e.g., |l9l [TOl [TTl [131 [141 [T6|). We will also omit discussion 
of important related developments, such as the dynamical interpretation of Sompolinsky and Zip- 
pelius II32I l33l l34l . We will concern ourselves instead with both the physical and mathematical 
interpretations of the Parisi solution, and the type of ordering that it implies. 

These interpretations took several years to work out, culminating in the work of Mezard et al. 
ll^lSn that introduced the ideas of overlaps, non-self-averaging, and ultrametricity as a means of 
understanding the type of order implied by the Parisi solution. These terms, and their relevance for 
the Parisi solution, will be described in Sec. |4l For now, we simply note that the solution of the 
infinite-ranged SK model generated tremendous excitement; as described by Rammal et al. [35 1, 
it displayed a new type of broken symmetry "radically different from all previously known". This 
is not an overstatement. 

The starting point is the observation that the low-temperature phase consists not of a single 
spin-reversed pair of states, but rather "infinitely many pure thermodynamic states" |29|, not re- 
lated by any simple symmetry transformations. This possibility had already been foreshadowed 
by the Thouless- Anderson-Palmer approach ll26l . whose mean-field equations were known to have 
many solutions (not necessarily all free energy minima, except at zero temperature ll36l ). The ex- 
istence of many states meant that the correct order parameter needed to reflect their presence, and 
to describe the relations among them. The single EA order parameter was therefore insufficient to 
describe the low-temperature phase (although it retained an important role, as we'll see); instead 
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one needed an order parameter function. 

Before we describe these ideas in more detail, we will first step back and consider the basic 
outline of the problem that interests us. In particular, we need to ask: what is it that we want to 
know? What are the fundamental open questions? And how do they tie in with the broader areas 
of condensed matter physics and statistical mechanics? These questions will be considered in the 
following section. 

3 Open Problems 

In this review we concern ourselves with perhaps the most basic questions that can be asked: is 
there a true spin glass phase, and if so, what is its nature? 

For the infinite-ranged SK model, these questions appear largely resolved, though some open 
questions remain. For the EA model (as a representative of more general "realistic" models, i.e., 
finite-dimensional and non-infinite-ranged), the primary question of whether a thermodynamic 
phase transition exists remains open. There is suggestive analytical ll37l l38l and numerical lEl 
l39l l40l |4T1 evidence that a phase transition to a broken spin-flip symmetric phase is present in 
three-dimensional and, even more likely, in four-dimensional Ising spin glasses. However, no one 
has yet been able to prove or disprove the existence of a phase transition, and the issue remains 
unsettled [42|. 

Of course, existence of a phase transition does not necessarily imply more than a single low- 
temperature phase; one could, for example, have a transition above which correlations decay ex- 
ponentially and below which they decay as a power law, with qea = all nonzero temperatures. 
However, most numerical simulations and theoretical pictures that point to a low-temperature spin 
glass phase suggest broken spin-flip symmetry. We are therefore led to: 

Open Question 1. Does the EA Ising model have an equilibrium phase transition above some 
lower critical dimension dc', and if so, does the low-temperature phase have broken spin-flip sym- 
metry? 

If the answer to this question turns out to be no, then subsequent research will need to focus on 
dynamical behavior, which — as in ordinary glasses — presents a range of difficult and important 
problems. However, given the reasonable possibility that there is indeed a sharp phase transition, 
it is worthwhile to ask: 

If there is a phase transition for the EA Ising model at some d > dc, what is the nature of the 
ordering of the low-temperature phase? 
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Because of the open-ended nature of this question, it won't be assigned a number; instead, 
we'll break it down into several parts. The remaining questions assume that there is an equilibrium 
phase transition critical temperature Tc > 0, below which there is broken spin-flip symmetry 
(equivalently, a phase with qea > 0), but we make no assumptions as to whether dc is less than or 
equal to three. 

Open Question 2. What is the number of equilibrium pure state pairs (at nonzero temperature) 
and ground state pairs (at zero temperature) in the spin glass phase? 

We have seen that the mean-field RSB picture assumes infinitely many such pairs. A competing 
picture, known as the droplet/scaling picture, due to Macmillan, Bray and Moore, Fisher and Huse, 
and others ESI l44l 1451 |46l|471|48l|49|, asserts that there is only a single pair of pure/ground states 
in the spin glass phase in any finite dimension. 

Because of the importance of this picture, we discuss it briefly here. "Domain wall renormal- 
ization group" studies 1143 11441 led to a scaling ansatz 11431 1441 l46l that in turn led to the development 
of a corresponding physical droplet picture l47l l48l l49l for spin glasses. In this picture, ther- 
modynamic and dynamic properties at low temperature are dominated by low-lying excitations 
corresponding to clusters of coherently flipped spins. The density of states of these clusters at zero 
energy falls off as a power law in lengthscale L, with exponent bounded from above by (d— l)/2. 
At low temperatures and on large lengthscales the thermally activated clusters form a dilute gas 
and can be considered as non-interacting two-level systems. The resulting two-state picture (in 
which there is no nontrivial replica symmetry breaking) is therefore significantly different from 
the mean-field picture arising from the SK model. 

So do spin glasses in finite dimensions have many equilibrium states or a single pair? Except 
in the highly disordered model lETlE^ . the answer is not known. In one dimension (where there 
is no internal frustration), there is only a single pair of ground states, and a single paramagnetic 
phase at all nonzero temperatures. In an infinite number of dimensions, there presumably would 
be an infinite number of pure state pairs for T < Tc. Recent numerical experiments lISOllSTllSlI 
seem to indicate a single pair of ground states in two dimensions (where it is believed that Tc = 0), 
but given that lattice sizes studied are still not very large, the question is not completely settled. 
Recent rigorous work by the authors ll53l l54l has led to a partial result that supports the notion 
that only a single pair of ground states occurs in two dimensions. In three dimensions numerical 
simulations give conflicting results 1155115^ . 

While the mean-field-like RSB many-state picture and the two-state droplet/scaling picture 
have historically been the main competing pictures, there are others as well. At least one of these 
will be discussed later. One often sees in the literature an unspoken assumption that the presence 
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of many states is synonymous with RSB, and similarly that the presence of only a single pair is 
equivalent to droplet/scaling. We emphasize, however, that while these are necessary requirements 
for each picture, respectively, they are not sufficient: each has considerable additional structure 
(which, in the mean-field RSB case, will be discussed in the next section). This then leads to our 
next question: 

Question 3. If there do exist infinitely many equilibrium states in some dimensions and at some 
temperatures, are they organized according to the mean-field RSB picture? 

Treatment of this question is the main theme of the remainder of this review. A series of both 
rigorous and heuristic results, due to the authors, has largely answered this question in the negative, 
and it is therefore not listed as open. (A complete discussion is given in Sec. |7I) However, there 
are remaining questions, such as: 

(Semi-)Open Question 4. What are the remaining possibilities for the number and organiza- 
tion of equilibrium states in the low-temperature spin glass phase? This question is examined in 
Sec.lO 

In discussing this, we will not consider every logical alternative to the mean-field picture, but 
rather what we consider to be the most likely remaining scenarios for the low-temperature phase 
of finite-dimensional spin glasses. 

The discussion so far has considered only equilibrium pure or ground states, with a view to- 
wards determining the nature of broken symmetry in realistic spin glasses. However, a more gen- 
eral discussion of thermodynamics and dynamics, particularly with a view towards explaining 
experimental observations, needs to include questions about other types of states, such as: 

Question 5. How are energetically low-lying excitations above the ground state(s) character- 
ized? (Sec.lO) 

Question 6. What can be proven about numbers and overlaps of metastable states? Do they 
have any connection(s) to thermodynamic pure states? (Sec. lll.ll ) 

Although many other important questions remain open, we close here with a question of more 
general interest than for spin glass physics alone: 

Question 7. In what ways do we now understand how the statistical mechanical treatment of 
frustrated, disordered systems differs in fundamental ways from that of homogeneous systems? 
(SecHH) 
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4 Nature of Ordering in the Infinite-Ranged Spin Glass 



We now return to a more detailed discussion of the nature of ordering implied by Parisi's solution 
of the SK model. As noted in Sec. 12.21 the RSB scheme introduced by Parisi assumes the existence 
of many equilibrium pure states. Because the notion of pure states has generated some confusion in 
the literature, we detour to clarify exactly what is meant by this and related terms. The discussion 
here closely follows Appendix A of lISTll . 

4.1 Thermodynamic Pure States 

The notion of pure states is well-defined for short-ranged, finite-dimensional systems, but is less 
clear for infinite-ranged ones like the SK model. We therefore begin with a discussion of the EA 
model (in arbitrary d < oo), and then briefly discuss application of these ideas to the SK model. 

Consider first Hj^l, the EA Hamiltonian (jSj) restricted to a finite volume of linear extent L. We 
will always take such a volume, hereafter denoted as Al, to be an cube centered at the origin. 
In addition, we need to impose boundary conditions, which we will often take to be periodic; other 
possibilities include antiperiodic, free, fixed (e.g., all spins on the boundary set equal to +1), and so 
on. Given a specified boundary condition, the finite- volume Gibbs state ^ on Al at temperature 
T is defined by: 

p'j^^A^) = Zr:}rexp{-nj,Lia)/kBT} , (6) 

where the partition function Z^^t is such that the sum of pj^^j. over all spin configurations in 
yields one. 

All equilibrium quantities of interest can be computed from p^j\{a), which is simply a prob- 
ability measure: it describes at fixed T the probability of a given spin configuration obeying the 
specified boundary condition appearing within A^. Such a (well-behaved) probability distribution 
is completely specified by its moments, which in this case is the set of all correlation functions 
within Al: (cr^j ■ ■ • a^rr,) for arbitrary m and arbitrary xi, . . . , G A^. 

Consider next the L —>■ oo limit of a sequence of such finite- volume Gibbs states p'^j\{a), 
each with a specified boundary condition (which may remain the same or may change with L). Of 
course, such a sequence may or may not have a limit; existence of a limit would require that every 
m-spin correlation function, for m = 1, 2, . . ., itself possesses a limit f5F|. A thermodynamic state 
p j^T is therefore an infinite-volume Gibbs measure, providing information such as the probability 
of any finite subset of spins taking on specified values; and of course it determines global properties 
such as magnetization per spin, energy per spin, and so on. 
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Thermodynamic states may or may not be mixtures of other thermodynamic states. If a ther- 
modynamic state p j;r can be decomposed according to 

PJ,T = )^Pj,T + (1 - ^)PJ,T > (7) 

where < A < 1 and and are also thermodynamic states (distinct from p), then p j- ^ is a 
mixed thermodynamic state or simply, mixed state. The meaning of the decomposition in Eq. Q 
is easily understood: it simply means that any correlation function computed using p j^t can be 
decomposed as: 

(c^xi ■ ■ = A(o-^i ■ ■ -o-^^^i^^ + (1 - A)(o-^i • ■ ■o-^^)p2^^ . (8) 

A mixed state may or may not be further decomposed into as many as an uncountable infinity of 
disjoint other states. 

We are now ready to define the idea of a thermodynamic pure state. If a distinct thermodynamic 
state cannot be written as a convex combination of any other thermodynamic states, it is then a 
thermodynamic pure state, or simply pure state. So the paramagnetic state is a pure state, as are 
each of the positive and negative magnetization states in the Ising ferromagnet. In that system at 
T < Tc, the Gibbs state produced by a sequence of increasing volumes, with either periodic or free 
boundary conditions, is a mixed state, decomposable into the positive and negative magnetization 
states each with A = 1/2. On the other hand, a sequence of increasing volumes with all boundary 
spins fixed at +1 leads to the positive magnetization pure state. 

A thermodynamic, or infinite- volume, ground state is a pure state at zero temperature consisting 
of a single spin configuration, with the property that its energy cannot be lowered by flipping any 
finite subset of spins ll59ll . 

A pure state pp can be intrinsically characterized by a clustering property (see, e.g., lISSllSOl '). 
which implies that for any fixed x, 

Wx(ry)pp - {(rx)pp{(ry)pp ^ 0, \y\^oo , (9) 

and similar clustering for higher order correlations. 

Without getting into technical details, it is already clear that a problem exists with extending 
the concept of pure (or for that matter thermodynamic) state to the SK model. Such states are 
defined for a fixed realization J' of all the couplings; but in the SK model the couplings all scale 
to zero as ^ oo. However, one can still talk in some rough sense about an SK state V with a 
"modified" clustering property 

{(Ti(^j)pv - {^i)pp{(^j)pv oo , (10) 
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for any pair i and j H- The problem with this is that there may be no measurable (i.e., effective) 
way to construct such a state (see Sec.|5]below). 

For now, we will ignore such difficulties and use the terms "pure state", "thermodynamic state", 
and so on, for the SK model also, as has been done extensively in the physics literature. It should 
always be kept in mind, though, that such usage is rough, and any attempt to make the notion more 
precise runs into serious difficulties (although we will propose a heuristic method for detecting the 
existence of many states in the SK model in Sec. |5l). Note that some of the difficulties discussed 
here are not present in the Curie- Weiss model of the uniform ferromagnet. Although couplings 
scale to zero there also, they "reinforce" each other, being nonrandom, so that N oo positive 
and negative magnetization states still make sense. It turns out that this fundamental difference 
between finite and infinite systems in the disordered case will have profound consequences. 

4.2 Overlap Functions and Distributions 

As noted in Sec. 12.21 Parisi's mathematical replica symmetry breaking scheme led to the physical 
interpretation of many pure states below Tc. All such states at fixed T have vanishing magnetization 
per spin as gets large, and all have the same (nonzero) qEA{T) JUITSl, so these alone are 
insufficient to describe the ordering. What is needed is a way to describe the relations among the 
different states, and this can be accomplished by means of overlaps. 

The usual interpretation of the Parisi solution is as follows [1211101 ED- For large A^, the 
Gibbs distribution is a mixture of many pure states: 

PjAT)^j:W^iT)p'}iT), (11) 

a 

where pj is pure state a, Wj its weight in the decomposition of pj^n{T), and the approximate 
equality sign indicates that the notion of pure state isn't precise in this model. Although Eq. dTTT) 
involves in principle an infinite sum, most weights are vanishingly small; only 0(1) states have 
appreciable weights as A^ ^ oo. 

The overlap between state a and (3 is defined as 

1 ^ 

i=l 

where is a thermal average in pure state a, and dependence on J and T has been suppressed. 
So qai3 is a measure of the similarity between states a and (3. It is clear that 

- Qea < Qap < Qea (13) 
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because qea = Qaa and —Qea = <ia-a, where —a is the global flip of a (i.e., all odd-spin correla- 
tion functions in a and -a have the same magnitude and opposite sign, and all even-spin correla- 
tions in the two are equal). 

Because there is no spatial structure in the infinite-ranged model, the overlap function does 
seem to capture the essential relations among the different states. However, it might already be 
noticed that such a global measure may well miss important information in short-ranged models 
— assuming that such models also have many pure states. 

Quantities referring to individual pure states are problematic, since there is no known procedure 
for constructing such things in the SK model. However, what is really of interest is the distribution 
of overlaps; i.e., if one randomly and independently chooses two pure states from pj ^iT) in 
Eq. dTTT) . the probability that their overlap lies between q and g + c/g is Pj{q)dq, where 

PA<D = Y.Y: W^W§6iq - q^p) . (14) 

a 13 

As before, we suppress the dependence on T and for ease of notation. Pj{q) is commonly 
referred to as the Parisi overlap distribution. 

What does Pj{q) look like? When there is a single pure state with zero magnetization per spin, 
such as the paramagnet, it is simply a (5-function at g = 0. For the Curie-Weiss Ising ferromagnet 
below Tc (as well as in short-ranged ferromagnets with, say, periodic boundary conditions), there 
are two pure states: the uniform positive and negative magnetization states, each appearing with 
weight 1/2 in a pure state decomposition of the type described in Eq. (fTTT) . The resulting overlap 
distribution is shown in Fig. 4. 

For the SK model, the overlap distribution for fixed J' is nontrivial, due to the presence of 
many non- symmetry -related pairs of states in the decomposition of the Gibbs distribution pj 
(cf. Eq. (fTTl) ). Now there are several (5-functions of nontrivial weight, distributed symmetrically 
about zero in the interval [—qsA, Qea], as sketched in Fig. 5. 

4.3 Non-Self-Averaging 

One of the most interesting and peculiar features of the Parisi solution is the non-self-averaging of 
the overlap distribution function. For large and fixed J', Pj{q) has the form shown in Fig. 5. 
What happens if one looks at a J' different from Jl Surprisingly, the overlaps (except for the two 
at rkqEA, which are present for almost every J) will generally appear at different values of g, and 
the set of corresponding weights will also differ. This is true no matter how large N becomes. If 
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P(q) 



-M^(T) M^(T) q 

Figure 4: Overlap distribution function P{q) for the Curie-Weiss Ising ferromagnet below Tc, 
or for short-ranged ferromagnets with periodic boundary conditions. In this figure, M(T) is the 
magnetization per spin and the spikes at ±M^(T) are 5-functions. 



P/q) 



^EA ^EA q 

Figure 5: Sketch of the overlap distribution function Pj{q) for the SK model below Tc 
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Figure 6: Sketch of the averaged overlap distribution function P{q) for the SK model below Tc. 
The spikes at ±qEA are 5-functions. 

one then averages Pj{q) over all J a.s N ^ oo, the resulting distribution will be supported on all 
values of q in the interval [—qsA, qsA]- 

Let PNiq) = Pj,N{q), where the overbar indicates a quenched average over coupling realiza- 
tions J, and let P{q) = liuiN^oo PN{q)- A sketch of the averaged overlap distribution P{q) is 
shown in Fig. 6. 

Together Pj{q) and P{q) can be thought of as describing the nature of ordering in the low- 
temperature phase of the SK model. Instead of P{q), one can study the function 



where x{q) is essentially the fraction of states with overlap smaller than q. This function, or more 
commonly its (monotonic) inverse q{x), is also commonly referred to as the Parisi order parameter. 
We will focus on P{q) here. 

The sample-to-sample variation, even in the thermodynamic limit, implied by the non-self- 
averaging of the overlap distribution function, may seem somewhat disturbing at first, since it 
violates our thermodynamic intuition of a "typical" sample. However, it should be remembered 
that Pj{q) is not directly measurable in the laboratory (though possibly information about it could 
be obtained indirectly). Measurable thermodynamic quantities, such as free energy, magnetization, 
and so on, remain self-averaging. 




(15) 
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Of course, P{q) is measurable through numerical simulations (see, for example, lEB). Prob- 
lems in the numerical determination of P{q) for short-ranged models will be discussed in Sec. l8.2l 

4.4 Ultrametricity 

The discussion in the preceding subsection concerned random choices of pairs of states taken from 
the Gibbs distribution pj^n{T). A striking prediction of the Parisi solution concerns the expected 
outcome when one independently chooses triples of states from pj^n{T). The disorder- averaged 
overlap probability distribution for triples of states, P{qi, q2, q3)dqidq2dq3, gives the probability 
that the spin overlap between one of the three pairs of states lies in [gi, qi + dqi], the second pair 
overlap in [q2, q2 + dq2], and the third in [gs, q^ + dqs]. An explicit calculation of P{qi, q2, qs) using 
the Parisi RSB ansatz yields ll30ll3Tl 





^P{qi)x{qi)6{qi - 


- q2)S{qi - 




+ 


\p{qi)P{q2)e{qi 


- q2)S{q2 




+ 


\p{q2)P{qs)e{q2 


- g3)5(g3 




+ 


\p{q,)P{qi)e{q, 




-12, 



That is, if one chooses three states independently from pj^^iT), then as oo there is a 

probability 1/4 that all overlaps are equal, probability 1/4 that qi = q2 < Qs, probability 1/4 that 
12 = 13 < Qi, and probability 1/4 that qs = qi < q2- That is, if dap = qsA — Qap is defined as the 
"distance" between states a and (3, then the distances among any three states chosen randomly from 
p form the sides of an equilateral (probability 1/4) or acute isosceles (probability 3/4) triangle. A 
distance metric with these properties is called an "ultrametric"; a detailed discussion is given in 
051 . So there are strong correlations among the states in the SK model, corresponding to a tree-like 
or hierarchical structure among their overlaps ll^^l . This is illustrated in Fig. 7. 

We have seen that the novel nature of the broken symmetry and ordering implied by the Parisi 
solution of the SK model is significantly different from anything observed in the low temperature 
phases of more familiar, homogeneous condensed matter systems. It is therefore not surprising that 
the Parisi solution, once it was understood, generated considerable excitement. Because mean-field 
theory has almost always provided the correct physics of the broken symmetry, ordering, and low 
temperature properties of more realistic models (typically providing poor quantitative results only 
close to Tc), it was natural to suppose that the RSB mean-field picture should similarly provide a 
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Figure 7: Rough sketch of the hierarchical structure of distances between states. A faithful rep- 
resentation of the actual tree corresponding to the Parisi solution would contain a continuous se- 
quence of branchings. 

correct description of the EA and other short-ranged spin glass models. In the next few sections 
we will consider this issue. 

5 Detection of Many States in Spin Glasses 

In describing the order parameters and broken symmetries of the SK spin glass phase, our starting 
point was the presumed existence of "infinitely many pure thermodynamic states" E^ . However, 
in Sec. 14.11 we cautioned about potential difficulties in applying these notions to the SK model. 
Are the objections raised there merely pedantic, or do they carry substantial physical significance? 
If the latter, how do we understand the physical meaning of the Parisi solution, and how can we 
apply it to the EA and other short-ranged models, where these concepts are better-defined? 

A second difficulty, also alluded to in Sec. 14.11 is the question of how one could actually 
construct a pure state in either the SK or the EA model. In homogeneous systems like the uniform 
ferromagnet, this presents no difficulties: to select out the positively magnetized pure state, for 
example, one could either introduce a bulk term (a positive, homogeneous external field) whose 
magnitude goes to zero, or a surface term (fixed boundary condition consisting of all plus spins), 
with volume going to infinity. However, even in the EA model, where the existence of well-defined 
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pure states can be proved, there is no known ^/-independent general procedure for constructing a 
single pure state if many are present. This difficulty has also been posed in the context of broken 
ergodicity ll63ll64l . 

In approaching these questions, it is worthwhile to ask: how can one even know whether there 
are multiple pure state pairs? Just as, in Sec. l4.2l one foregoes examination of individual pure states 
in the SK model for statistical information regarding their overlaps, we will similarly abandon the 
idea of attempting to construct individual pure states for a broader study of how the properties of 
the system are affected if many pure states exist. To accomplish this we need to ask whether one 
can construct a simple and unambiguous procedure both for detecting the existence of multiple 
states, and for studying their properties. In doing so, we will arrive at a deeper understanding of 
the meaning and consequences of the existence of many states in disordered materials; and we will 
simultaneously achieve a clearer, and deeper, understanding of the meaning and significance of the 
Parisi solution for the SK model. The first step is showing the connection between the existence of 
multiple states and the presence of what we have called chaotic size dependence ll65l . 

5.1 Chaotic Size Dependence in the SK model 
5.1.1 States 

We noted in Sec. 14. II that a thermodynamic state, pure or mixed, can be constructed as the infinite- 
volume limit of a sequence of finite-volume Gibbs distributions. In the Curie- Weiss model, and 
again ignoring various technical complications in definitions of pure states, one can study the 
effects of adding a spin to an A^-spin system, which simultaneously requires the introduction of 
new couplings. (In spin glasses, this approach has been termed the "cavity method" lfT3l .) It is 
clear that addition of a single spin will not substantially alter a fixed correlation function, whether 
single- or multi-spin. One can therefore sensibly conceive of a limiting thermodynamic state (in 
this case a mixture of positive and negative uniformly magnetized states, each with probability 
1/2). 

In the SK model, though, the situation is radically different. As ^ oo, any specified corre- 
lation function should not depend on any finite set of couplings, because the overall magnitude of 
any such finite set scales to zero and each of the new couplings accompanying each additional spin 
is chosen independently of the previous ones. What this suggests is that (below Tc) any specified 
correlation function will not settle down to a limit as oo; equivalently, the cavity method does 
not result in a limiting thermodynamic state. This heuristic argument introduces us to the pervasive 
presence of chaotic size dependence in spin glasses. For recent results on this issue, see ll^ . 
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If such a straightforward procedure does not resuh in a thermodynamic state, then does the 
notion of many pure states in the SK model make sense? In one way, at least, the answer is yes, 
even though the meaning of an individual pure state is still imprecise. In an operational sense, one 
could in principle keep a record of the values of a finite set of even correlation functions (with, 
say, free boundary conditions) as grows (at fixed T). If these values approach a limit, one can 
with some justification describe the low-temperature phase as consisting of a single pair of states 
(because each finite-spin state would simply be an equal mixture of the two). If, however, the 
correlation functions persist in changing their values as N grows, then one can infer that there 
must exist many such pairs — presumably infinitely many, if there is no repetitive pattern. 

Now it is true, by compactness arguments, that in the latter case there must exist (infinitely 
many) subsequences that result in distinct limiting states. But it is also almost certainly true that 
there is no measurable way of doing this; i.e., no procedure for selecting subsequences that is in- 
dependent of a specific coupling realization J. The consequence is that there is no finite procedure 
for selecting convergent subsequences, and therefore generating thermodynamic states. 

However, while generating individual states seems to be problematic, it is nonetheless possible 
to devise simple procedures for measuring statistical ^xo^QxiiQ^ of such states. So the focus should 
not be on individual states, as in the conventional statistical mechanics of ordered systems, but 
instead on some larger construct that measures such statistical properties. This will be further 
discussed in Sec. |6l 

5.1.2 Overlaps 

States represent local quantities (i.e., correlation functions), and so depend on details of the cou- 
pling realization J . Global quantities, on the other hand, such as free energy per spin, should 
depend only on general parameters of the coupling distribution (such as its mean and variance), 
and therefore should have (the same) thermodynamic limit for almost every J Il67ll68ll69l . (From 
here on, we use the term "almost every", abbreviated "a.e.", in the strict probabilistic sense: that 
is, a result holding for "for a.e. J" means it holds for every coupling realization except for a set of 
measure zero in the space of all coupling realizations). 

What about a quantity like Pj^NiQ)^ The fact that it's non-self-averaging already indicates 
that, although also a global measure, it may not have an ^ oo limit for a.e. J' (using any 
coupling-independent procedure, i.e., one that is both measurable and finite). This intuition was 
made rigorous in fE5], as the following result: 

Theorem 1 I^SJ. If Pj n{(i) has a limit Pj{q) for a.e. J, then it is self-averaged; i.e., Pj{q) is 
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independent of J for a.e. J . 

Proof. To prove this, we study Yj^fq{t), the Laplace transform of Pj^n{sI)'- 

Yj^N{t) = J dq Pj^Niq) . (17) 

Consider two coupling realizations, J' and J'', that differ in only finitely many couplings. Then 
because the coupling magnitudes in the SK model scale as N^^/"^, it follows that 

Yj,,M{t)/Yj,r,{t) = e^(^"'') (18) 

so if Yj{t) = \im.N-^ooYj^N{t) exists for a.e. J, Yj/{t) = Yj{t) for any J and J' differing by 
a finite number of couplings. But by the Kolmogorov zero-one law [70|, it follows that for each 
fixed t, Yj{t) is constant for a.e. J, which in turns implies that, for any q, Pj{q) is independent of 
J for a.e. J. o 

Here chaotic size dependence seems to follow from the scaling of the coupling magnitudes to 
zero as ^ oo, with the result that no local state properties depend on a finite set of couplings. 
While this is part of the story (and in fact, an important part), it is not the entire story. In short- 
ranged models like the EA spin glass, coupling magnitudes are fixed independently of volume, but 
as we shall see in the next section, chaotic size dependence is present there also, although certain 
differences now appear between the infinite- and finite-ranged models. 

5.2 Chaotic Size Dependence in the EA model 
5.2.1 "Observability" of States 

We already noted in the previous section that one important difference between the EA and the SK 
models is that coupling magnitudes scale to zero in the latter but not the former. While this is also 
true in infinite-ranged models in homogeneous systems, the randomness in the couplings in the 
disordered case results in significant differences between short-ranged and infinite-ranged models. 

As before, consider a volume in the EA model. Boundary conditions, such as free, periodic, 
antiperiodic, or fixed, now need to be specified. (In some rough sense, one can think of the SK 
model as having free "boundary" conditions.) Recall that in the homogeneous Ising ferromagnet 
below Tc, different pure states can be generated by using sequences of plus vs. minus boundary 
conditions. So one test of multiple states is the sensitivity of correlation functions, deep in the 
interior, upon change of boundary conditions far away. 
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If there is only a single pure state (e.g., a paramagnet), then any sequence of boundary con- 
ditions results in that single limiting state, and there is no chaotic size dependence. If broken 
spin-flip symmetry exists, i.e., there is a phase with qea > 0, then there must be different se- 
quences of boundary conditions leading to different limiting states. But how can we use this fact 
to determine whether there is only a single pair of pure states, as in the droplet/scaling picture, or 
infinitely many pairs, as would be required, for example, by an RSB-like picture? 

We start by defining an observable state. We do not expect observable physical properties 
to depend on the microscopic details of the couplings, but instead on macroscopic properties. For 
example, in a dilute magnetic alloy, one needs to study the system without knowing the microscopic 
locations of all the magnetic impurity atoms. As a consequence, measurements on a spin glass are 
necessarily made in a manner independent of the microscopic coupling realization corresponding 
to that particular sample. 

This suggests that physical properties should be associated with states that are mathematically 
constructed in a coupling-independent manner; in particular, by using boundary conditions that do 
not depend on the couplings JTTllVH- We are therefore led to the following: 

Working Definition: An observable state is a thermodynamic state, pure or mixed, whose 
existence is manifested through some sequence of coupling-mJepen Jen? boundary conditions. 

This working definition is not mathematically precise, but will be made so in Sec. 16.2.11 The 
definition suggests the possible existence of other, "invisible", states; these will be briefly discussed 
in Sec. El 

Clearly, the many states appearing in the Parisi solution of the SK model are observable. But 
this then leads to another question: instead of bothering with boundary conditions, why not use the 
overlap measure Pj{q) to detect many states in the EA model, just as it was successfully used in 
the SK model? As we will see in Sec. 18.21 Pj{q) turns out in general to be an unreliable indicator 
of the existence of many states in short-ranged models (whether homogeneous or disordered); it 
can give the appearance of many states where there is only a single pair, and the appearance of 
only a single pair — indeed, sometimes even only a single state — when there are infinitely many. 

So how can one distinguish between the presence of infinitely many pure states vs. only a single 
pair for the EA model? In the next two subsections, we will show that the answer lies in studying 
spin-flip symmetric boundary conditions. 
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5.2.2 Sensitivity to Boundary Conditions and "Windows" 

The definition of observable states given in the previous section still seems somewhat impractical, 
or at least not "finite", since it involves the existence of infinite- volume limits. However, its conse- 
quences are indeed practical and finite, in particular for numerical experiments. For example, one 
implication is that the presence of multiple obervable states manifests itself as a sensitivity of cor- 
relation functions deep in the interior of a finite volume A^^ to changes in the boundary conditions 
on OAl. 

In order to make this idea precise, consider a fixed volume A^^ within which correlation func- 
tions are studied, centered inside a much larger volume A^. We will call A^o a "window" fl3\. 

Suppose now that there exists only a single pure state at some temperature T; for sufficiently 
high T in either the EA or SK models, this would be the paramagnet. As noted in the previous 
section, any infinite sequence of boundary conditions will result in this single limiting pure state. 
(In the above sentence, and throughout the paper, "infinite sequence of boundary conditions" is 
shorthand for an infinite sequence of finite-volume Gibbs states, as in Eq. Q, generated by a 
sequence of volumes with the specified boundary conditions.) As a consequence, if one looks at a 
fixed window A^^o inside a much larger volume A^, any change in the boundary conditions on dAj^ 
will leave the correlation functions inside the window largely unaffected (with any small effects 
vanishing as the boundaries recede to infinity.) 

Suppose now that there are two pure states, say the positive and negative magnetization states in 
the Ising ferromagnet. If one switches from the fixed boundary condition on c^A^ with all boundary 
spins +1, to the fixed boundary condition with all boundary spins —1, correlation functions every- 
where inside the volume will change (corresponding to a change from the positively magnetized to 
the negatively magnetized state), no matter how large L becomes. 

So the presence of multiple Gibbs states results in sensitivity to boundary conditions. Demon- 
stration of such sensitivity in spin glasses at sufficiently low but nonzero temperature in a given 
dimension would already be sufficient to answer Open Question 1 . More is needed, however, if 
one wants to address the issue of whether there is a single pair of pure states or infinitely many. 

5.2.3 Domain Walls and Free Energies 

As noted in Sec. 14.21 an infinite sequence of periodic boundary conditions in the (uniform or 
random) Ising ferromagnet, above the lower critical dimension and below Tc, does lead to a limiting 
mixed state pper = |p+ + |p-, where p+ is the positively magnetized and p_ the negatively 
magnetized state. If these are the only pure states, then any sequence of antiperiodic boundary 
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conditions will also have a limit and yield the same mixed state. Of course, there will be a relative 
domain wall between periodic and antiperiodic b.c. states in a fixed volume, but as the volume size 
increases, the domain wall eventually moves outside of any fixed window. In such a scenario we 
say the domain wall has "deflected to infinity". 

One can prove a similar result in the EA Ising spin glass with periodic, antiperiodic, free, or 
other "symmetric" boundary conditions. By symmetric b.c. we mean one for which the resulting 
Gibbs state pl in any is spin-flip-invariant; that is, all odd correlations vanish. In a spin glass, 
if there is only a single pair of pure states p and p that transform into each other under a global 
spin flip (as in the droplet/scaling picture), then any sequence of symmetric boundary conditions 
has a limiting thermodynamic state ll65l . which is simply the mixed state psym = |p + |p- As a 
consequence, switching from periodic to antiperiodic b.c.'s in a large volume leaves the Gibbs state 
unaffected inside a window deep in the interior. 

What happens if there are many pure state pairs, as would be the case in a mean-field-like pic- 
ture? In this case, two arbitrarily chosen pure states (not from the same pair) would have relative 
domain walls that do not deflect to infinity. If the free energy cost of such domain walls does not 
exceed the free energy difference in a typical A l incurred by switching from, say, periodic to an- 
tiperiodic boundary conditions, then these different pairs of states should be observable under such 
a switch. In other words, if many pure state pairs exist, and their relative free energy differences 
are not too large, then switching from periodic to antiperiodic b.c.'s in a typical Aj^ should change 
the Gibbs state deep in the interior. 

How large is "not too large"? A trivial upper bound is a domain wall whose free energy scales 
as L'^^^ or smaller, since a switch in boundary conditions obviously cannot result in a greater free 
energy change. But in the EA model, a much better bound can be found rigorously. At fixed 
temperature, if one switches from periodic to antiperiodic b.c.'s then in A^, the root mean square 
free energy difference is bounded from above by 0(L'^'^~^)/^), i.e., the square root of the surface 
area ll65l l74l . This rigorous result, which we present here without proof, and which applies to 
other "flip-related" ll65ll coupling-independent b.c.'s, supports Anderson's 11201 intuitive notion of 
frustration described in Sec. l2.1.fl 

This suggests the following picture: in dimensions with broken spin-flip symmetry, there exists 
an exponent 0{d) with < 0{d) < (d — l)/2 ll46ll49ll that governs free energy fluctuations upon 
a switch from periodic to antiperiodic b.c.'s. If many pure state pairs exist, and their lowest-lying 
relative domain wall energies scale as or less, then the Gibbs state p^ in a typical A^ will be 
sensitive throughout the entire volume to changes in coupling-independent b.c.'s, irrespective of 
the size of L. In other words, these many pure state pairs are observable in the sense described in 
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Sec. Ism 

What is expected in a mean-field-like scenario for the EA model? If the many pure state 
pairs there are not observable, a case could be made that they are unphysical and not of great 
interest. However, because they are seen in the SK model under what can roughly be thought of 
as (coupling-independent) free boundary conditions, one would expect the analogous states — if 
they exist — in the EA model to be observable also. In fact, RSB theory predicts that domain 
walls between such states are both "space-filling" (to be discussed in Sec.|9l) and with energies of 
0(1) independent of lengthscale |I75ll26l|771|78l|. They therefore must manifest themselves under 
a change from, say, periodic to antiperiodic boundary conditions I75J in a typical large Kl- 

5.2.4 Many States and Chaotic Size Dependence 

The discussion so far indicates that the existence of many pairs of "SK-like" pure states in the 
EA model leads to chaotic size dependence: if one takes a sequence of volumes all with, e.g., 
periodic boundary conditions (with the volumes chosen deterministically, i.e., independently of 
the couplings) then there will almost surely be no limiting thermodynamic state. That is, a typical 
n-spin correlation function, computed in each using the corresponding finite- volume Gibbs 
state, will change continually as L ^ oo, never settling down to a limit. 

This leads to an interesting alternative formulation of the problem of existence of many pure 
state pairs in the EA model. Consider any arbitrary deterministic sequence of volumes with sym- 
metric (periodic, antiperiodic, free, or other) b.c.'s. If there exists only a single pair a, a of (observ- 
able) states, as in the droplet/scaling model, then for fixed J such a sequence will {with probability 
one over the J's) possess a limit: the thermodynamic state p = + |a. If instead there are two 
or more (observable) pure state pairs, then there will be chaotic size dependence: with probability 
one, such a sequence will not converge to a limiting thermodynamic state. 

The precise statement underlying these conclusions is the following: 

Theorem 2 ll65l . Given a symmetric coupling distribution, suppose that a sequence of coupling- 
independent boundary conditions results in a limiting thermodynamic state p. If in every volume in 
the sequence (or an arbitrary subset chosen independently of the couplings), the original boundary 
condition is replaced by one that is flip-related, then (1) the new sequence will also have a limit, 
which (2) will be the same thermodynamic state p. 

Remark. By "flip-related" b.c.'s we mean that for each L, there is some Bi C SA^ whose flip 
transforms one b.c. into the other. So, for example, periodic and antiperiodic b.c.'s are flip-related; 
so are two different fixed b.c.'s. However, periodic and fixed b.c.'s are not flip-related. 
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The proof of the second conclusion is fairly straightforward, and will be useful later, so we 
present it here. For a proof of the first conclusion, see ll65l . 

Proof of Part 2. Consider the correlation function of the spins at the m sites ii, . . . ,im- For 
each L, call this m-point correlation function for b.c. 1 and Xl for b.c. 2, which is flip-related 
to b.c. 1. Xl and Xl are bounded between —1 and +1 for all L and all J'. The limits X^ = 
liniL^ooXl and = Mirl^^XI exist by assumption, and are functions of J. Let X{J) = 
X\J)-X\J). 

Consider now the conditional expectation Er[-], defined as the expectation of a quantity after 
averaging over all couplings outside A^; so Er[-] depends on the couplings only inside A^. Then 

E,[X] = lim E,[Xl] = lim (Er[Xl] - Er[Xl]) (19) 

exists. Because r and m are fixed, and L — oo, eventually L > r and {ii, . . . , im C Al} for any r 
and m. But because Er[] averages over the boundary bonds of the cube, and the b.c.'s 1 and 2 are 
flip-related, it is easy to see that Er[Xl] = Er[Xl] for large L and hence that -Er[-^] = for every 
r. If a bounded random variable X has zero conditional expectation for every r, then X = (for 
a.e. J'). The claimed result follows, because the same argument holds for all correlation functions, 
o 

Chaotic size dependence in the presence of many states is intuitively plausible. Suppose that 
there exists infinitely many pure state pairs. For a given A^, some subset of those states will have 
larger weights than others; in a rough sense, they will be those which best "match" the boundary 
condition for that L. As L varies, the selected states with large weights should vary in some 
unpredictable fashion. The theorem simply proves this plausible scenario. 

There is a numerical consequence of this observation. Just as the presence of many states is in 
principle detectable numerically by looking at sensitivity of the state in the deep interior to changes 
in the boundary condition in a fixed volume ('Sec. l5.2.3t . one can also look numerically for chaotic 
size dependence; that is, study a given set of correlation functions as the volume size changes for 
a fixed b.c. (such as periodic). 

It may now seem that chaotic size dependence adds a layer of complexity to the study of ther- 
modynamic states in spin glasses. How can one even talk about pure states when there now seems 
to be no measurable way to construct them (if there are infinitely many)? A new thermodynamic 
tool seems to be needed; such a tool will be presented in the next section. 
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6 Metastates 



6.1 Motivation and Mathematical Construction 

If there exist many observable pure states, a sequence of coupling-independent b.c.'s will generally 
not converge to a limiting thermodynamic state: there is chaotic size dependence (hereafter denoted 
CSD). That is, a typical correlation (cTj^ . . . cTj,^), computed in from the finite- volume Gibbs 
state, will not have a single limit as L ^ oo but rather many different limits along different 
subsequences of L's (chosen in a coupling-dependent manner). 

Such behavior in L is analogous to chaotic behavior in time t along the orbit of a dynamical 
system. Of course, in each case the behavior is deterministic but effectively unpredictable, and 
appears to be a random sampling from some distribution k on the space of states. In the case of 
dynamical systems, one can in principle reconstruct n by keeping a record of the proportion of 
time the particle spends in each coarse-grained region of state space. Similarly, one can prove 
ifTSl l79l that for inhomogeneous systems like spin glasses, a similar distribution exists: roughly 
speaking, the fraction of A^s in which a given thermodynamic state T appears converges, even 
in the presence of CSD. By saying that a thermodynamic state T (which is an infinite-volume 
quantity) "appears" within a finite volume Al, we mean the following: within a window deep 
inside the volume, all correlation functions computed using the finite-volume Gibbs state pi are 
the same as those computed using T (with negligibly small deviations). The state F can be either 
pure or mixed, depending on the boundary conditions. 

Mathematically, a metastate k is a probability measure on the space of all (fixed J') thermo- 
dynamic states. Of course, the metastate depends on the boundary conditions used: we will refer 
to the metastate constructed from a deterministic sequence of volumes, all with periodic boundary 
conditions, as the "periodic b.c. metastate", and similarly for the antiperiodic b.c. metastate, the 
free b.c. metastate, and so on. One can also construct metastates in which the b.c.'s vary with L. 

A simple empirical construction of k would be as follows: consider a "microcanonical" en- 
semble kl, in which each of the finite volume Gibbs states p^^\ . . . , p*^^-* in volumes Ai, . . . , A^ 
has weight L^^. Then k = limi_^oo f^L- The meaning of the limit is that for every well-behaved 
function g{-) on states, 

lim L-'j:gip^'^) = {giT)}^ , (20) 

where the bracket {.j^ denotes the average over k. 

There is an alternative (and earlier) construction due to Aizenman and Wehr lISOl . In this 
construction, one replaces the microcanonical ensemble by the ensemble of states obtained by 
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varying the couplings outside Kl. The limit here means that for every well-behaved function F of 
finitely many couplings and finitely many correlations, 



lim [F{J,p^^'^)U=\{F{J,V)} 



(21) 



Here, []av denotes the average over the quenched coupling distribution. In fact it has not yet been 
proved that these relatively simple limits, using all t% and L's , are valid. However, it can be 
proved ifTSl that there exist deterministic (i.e., jT-independent) subsequences of £'s and L's for 
which limits such as in both Eq. (l20b and Eq. (1211) exist and yield the same k{J). 



6.2 Physical Meaning and Significance 
6.2.1 Observable States and Thermodynamic Chaos 

Like a thermodynamic state F, the metastate k is an infinite-volume probability measure. But while 
r is a measure on spin configurations, k is a measure on the thermodynamic states themselves. That 
is, r provides the probability that a given spin configuration appears inside a finite region, while 
the metastate k provides the probability that a given pure or mixed state appears inside a typical 
large volume Aj^ with specified b.c.'s. As such, the metastate contains far more information than 
any single thermodynamic state. 

So, instead of treating CSD as a problem and trying to do an "end run" around it, introducing 
metastates allows us to exploit the vast amount of information contained within CSD; for fixed J, 
a metastate allows us to analyze how the finite volume Gibbs states pi with given boundary con- 
ditions sample from the available set of thermodynamic states. Although the metastate concept is 
equally applicable to situations where CSD does not occur, it is most useful as a tool for analyzing 
"thermodynamic chaos". 

As always, we are interested in metastates constructed using coupling-independent boundary 
conditions. This allows us to redefine somewhat more precisely the notion of an observable state 
roughly defined in Sec. 15.2.11 

Definition: An observable state is a thermodynamic state, pure or mixed, that lies in the sup- 
port of some coupling-independent metastate. 



6.2.2 Finite vs. Infinite Volumes 

Another useful consequence of using metastates is that they enable us to relate the observed be- 
havior of a system in large but finite volumes with the system's thermodynamic properties. This 
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relation is relatively straightforward for systems with a few pure states or for those whose states 
are related by well-understood symmetry transformations; but in the presence of many pure states 
not related by any obvious transformations, this relation may be subtle and complex. Here the 
metastate approach may be not only useful but necessary. 

Occasionally a distinction is drawn between finite- and infinite- volume states (see, for example, 
lISTl ). where it is argued that the first is more physical and the second merely mathematical in 
nature. While we will see below (see also 111511651173117911821 ') that the relation between the two 
may be more subtle than previously realized, we also argue that such a distinction is misleading. 
Indeed, it should be clear from the discussion above that the metastate approach is specifically 
constructed to consider both finite and infinite volumes together and to unify the two cases. 

7 Can a Mean-Field Scenario Hold in Short-Ranged Models? 

We have now developed the tools we need to analyze whether the type of ordering present in 
the RSB solution of the SK model can hold in more realistic short-ranged models. The two most- 
discussed scenarios have been the many-state mean field picture described above, and the two-state 
droplet/scaling picture introduced in Sec. 13 We will see below that application of the RSB picture 
to short-ranged models is not at all straightforward, resulting in considerable confusion in the 
literature. Before we turn to that subject, however, we need to examine a preliminary question: at 
fixed dimension and temperature, why can't it be that the mean-field scenario holds for, say, half 
of all coupling realizations and droplet/scaling for the other half? 

7.1 Translation-Ergodicity 

In fact, such a possibility cannot occur: any type of ordering, based on multiplicity of states, 
whether it's one of the above or something else entirely, must occur either for every J (except for 
a set of measure zero) or for none. The proof of such a statement lies in a straightforward use of 
the ergodic theorem [83|. Because the ideas used here will be useful later on, we make a small 
detour to explain it more fully. 

As always, we assume a fixed coupling distribution y{J), in which the couplings are indepen- 
dent, identically distributed random variables. At some fixed dimension d and temperature T, let 
A/'((i, T, J) denote the number of pure states (one or two or . . . oo). Then it can be proved that 
A/'((i, T, J) is constant almost surely; i.e., it is the same for a.e. J, at fixed T and d. (Of course, 
A/'(c?, T, J) can and — if there is a low-temperature spin glass phase — will have some depen- 
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dence on both d and T. It also clearly can depend on u, although that dependence is not explicitly 
indicated.) In the language of spin glass theory, A/" is a self-averaged quantity. 

The proof depends on three ingredients: measurability of A/" as a function of J', translation- 
invariance of J\f with respect to a uniform shift of the couplings, and translation-ergodicity of 
the underlying disorder distribution u. A discussion of measurability (in the mathematical sense) 
would be somewhat technical and will be avoided here, and a precise definition will not be given; 
but, roughly speaking, it implies, for a function on random variables, that there is an explicit 
realization-independent procedure for constructing it. A proof that J\f is measurable is given in 

ca. 

The concepts of translation-invariance and translation-ergodicity are relatively straightforward, 
and we discuss them informally here. Let a be any lattice translation; then J'"- indicates the cou- 
pling realization with the locations of all couplings in J' uniformly shifted by a. A translation- 
invariant function / on ^7 is one where f{J"') = f{J) and a translation-invariant distribution of 
J''s is defined similarly. Clearly, both H and the disorder distribution v are translation-invariant. 

Translation-ergoJ/c/fy of a probability measure, such as u, is analogous to the more familiar 
notion of time-ergodicity. Consider again a function g of J, with J chosen from some distribution 
/i; g may or may not be translation-invariant. The distribution-average Eij_[g] of g is what we 
normally refer to simply as the average; that is 

EM = J dj fi{J)g{J) . (22) 

But a translation-average Et[g] can also be defined for any realization J', as simply the spatial 
average of giJ) under all lattice translations JT"". Then the distribution n is translation-ergodic if 

E,[g] = Et[g], (23) 

for a.e. J. 

By the ergodic theorem, any (measurable) translation-invariant function of J' chosen from a 
translation-ergodic distribution is constant almost surely (that is, is the same for a.e. realization of 
J). 

Informally, this is easy to see: by definition, a translation-invariant function is constant with 
respect to any lattice translation of the realization on which it depends. Suppose that g{J^) is 
translation-invariant for a.e. J', and suppose (for example) that it equals the constant gi for half 
of all realizations and g2 for the other half, with gi ^ g2. Then the distribution-average Efj^[g] = 
(l/2)((7i + (72), which is not equal to giJ) for any J (outside of a possible set of measure zero). 
But this violates Eq. (l23l) . contradicting the supposition that /i is a translation-ergodic distribution. 
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Returning to the question of the possible variability of the number of pure states with J , we 
recall that the couplings are independent, identically distributed random variables. The distribution 
for such random variables is translation-ergodic ll84ll . and so v[^J) is translation-ergodic. So, 
because A/" is a translation-invariant function of J , which is drawn from the translation-ergodic 
distribution ^{J), it follows that M is the same for a.e. J (at fixed T and d). Of course, this 
argument doesn't tell us the value of A/" at a given T and d, only that it's constant with respect to 
J. 

This argument has been presented in some detail not because there is any controversy on this 
particular question - there isn't - but because similar arguments can be used to resolve issues that 
heretofore had been controversial. We will turn to these issues in the following sections. Before 
doing so, we note that these and similar results allow us to make statements like "The number 
of pure states in a spin glass at low temperatures in three dimensions is s." What this statement 
really means is that, with probability one, for any particular realization of the couplings on a 
three-dimensional lattice, there are x pure states at that temperature. (Even a statement such as 
this, however, should specify whether one is talking about observable states only, but that will be 
assumed in what follows. We conjecture, but have not proved, that the same number of pure states 
will be in the support of a.e. coupling-independent metastate.) 

7.2 The Standard SK Picture 

We now turn to an examination of whether a mean-field-like picture can hold in short-ranged spin 
glasses like the EA model. It may seem initially that the outlines of such a picture should be clear. 
A typical description is given in ll85l : 

"Hence the Gibbs equilibrium measure decomposes into a mixture of many pure states. This 
phenomenon was first studied in detail in the mean field theory of spin-glasses, where it received 
the name of replica-symmetry breaking . . . But it can be defined in a straightforward way and easily 
extended to other systems, by considering an order parameter function, the overlap distribution 
function. This function measures the probability that two configurations of the system, picked 
up independently with the Gibbs measure, lie at a given distance from each other . . . Replica- 
symmetry breaking is made manifest when this function is nontrivial." 

But if there are many pure states, then there must be CSD; and if there is CSD, what does one 
mean by the equilibrium Gibbs measure? This question was first addressed in ll86ll . where it was 
shown that the most natural and straightforward interpretation of statements like the one above 
— what we have called the standard SK picture — cannot hold in short-ranged models in any 
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dimension and at any temperature. 

The difficult part in studying this problem is that of constructing limiting Gibbs states, given 
the presence of CSD when there are many states — but the notion of the metastate now makes it 
easy (or at least easier). In ll86l . two constructions of overlap distributions were given, but we use 
metastates here to simplify the discussion. Before proceeding, we will use the description above 
to construct the standard SK picture. 

The paragraph from ll85ll quoted above, as applied to the EA model at fixed temperature T, 
requires a Gibbs equilibrium measure pj{a) which is decomposable into many pure states Pjicr): 

PJ{^) =llWjPji^) ■ (24) 

a 

One then considers the overlap distribution function Pj{q), constructed as described above. 
That is, one chooses a and a' from the product distribution pj(a)pj{a'), and then the overlap 

Q= lim (25) 

has Pj as its probability distribution. Here \Al\ is the volume of the cube A^. 

Given Eq. (l24b . there is a nonzero probability that a and a' will be chosen from different pure 
states. If a is drawn from pj and a' from pj, then the expression in Eq. (l25t equals its thermal 
mean, 

qf = lim \Al\-' E {^^)a{cr.)p • (26) 

Thus Pj is given by 

Pjiq)=j:^^WjS{q-qf) • (27) 

In the mean-field picture, the Wj's and are non-self-averaging quantities, except for 
a = P or its global flip, where qj^ = ±qEA- As in Sec. 14.31 the average P{q) of Pj{q) over the 
disorder distribution v of the couplings is a mixture of two delta-function components at rLqEA and 
a continuous part between them. 

The problem, as already noted, is constructing pj{a) given the presence of CSD: simply taking 
a sequence of cubes with periodic b.c.'s, for example, won't work. However, consider the periodic 
b.c. metastate k (in fact, any coupling-independent metastate would do). One can construct a 
state pj{cr) which is the average over the metastate: 

pj{a) = J Tia)KjiT) dV . (28) 
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One can also think of this pj a& the average thermodynamic state, A^^^ {pj + pj + . . . , pj^ ), 
in the limit iV ^ oo. It can be proved ||T5l[80|| that pj{(y) is indeed a Gibbs state. 

One can also construct overlaps without constructing Gibbs states at all, as is done numerically. 
Such a construction (similar to that above) is described in ll86ll . and leads ultimately to the same 
conclusion. 

It is easy to show, given the torus-translation symmetry inherent in periodic b.c.'s, that the 
Gibbs state pj{cr) is translation-covan'an?; that is, pj^{ci) = pj{a^"-), or in terms of correla- 
tions, {ax)ja = {crx-a)j- Translation covariance of pj immediately implies, via Eqs. (I25t - (l27t . 
translation invariance of Pj. But, given the translation-ergodicity of the underlying disorder dis- 
tribution u, it immediately follows that Pj{q) is self-averaging, and equals its distribution average 
P{q) for a.e. J . The same result can be shown for other coupling-independent b.c.'s, where torus- 
translation symmetry is absent, using methods described in lISTI . A simple argument, given in [ 86|, 
shows further that nontrivial ultrametricity, as in the Parisi solution of the SK model, cannot hold 
among three arbitrarily chosen states. 

So the most natural interpretation of the RSB picture cannot be applied to short-ranged spin 
glasses. The question then becomes: are there alternative, less straightforward interpretations? 

7.3 The Nonstandard SK Picture 

The standard SK picture follows a traditional approach in its focus on thermodynamic states. We 
argued in Sec. I^that for inhomogeneous systems like spin glasses, such a focus is too restrictive 
if many pure states are present. Instead, the metastate approach is far better suited as a guide for 
analyzing these kinds of systems. 

We have mentioned above ('Sec. l5.2.n) . and will describe in detail below, the issue of the overlap 
function being a poor tool for determining numbers of pure states in short-ranged models. 
For the moment, however, let's assume that this is not the case, and that numerical simulations on 
the EA model in three and higher dimensions detect a Parisi-like overlap structure (see, e.g., ||88|). 
Does the interpretation given in the cited paragraph in Sec. I7.2l necessarilv follow? The answer is 
no\ it was shown in iTT^ that any evidence for RSB arising from numerical studies of -P(g) can 
correspond to more than one thermodynamic picture. This leads to a reinterpretation not only of 
what broken replica symmetry might mean in short-ranged systems, but also what it does mean in 
the SK model. 

In numerical computations, overlaps are by necessity computed in finite volumes. Because of 
CSD, it cannot be assumed that a simple L ^ oo extrapolation leads to a single thermodynamic 
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mixed state whose decomposition includes all of the observable pure states of the system. But if 
one is indeed observing a nontrivial (i.e., decomposable into many pure states) mixed state T in 
one volume, why should one expect that a similar observation in a different volume corresponds 
to the same F? In fact, the presence of CSD indicates that this cannot be the case for all large 
volumes. 

As a mathematical aside, the standard SK picture effectively corresponds to breaking the replica 
symmetry after the thermodynamic limit has been taken. Numerical studies, however, essentially 
break the replica symmetry before taking the thermodynamic limit. Guerra ll89ll has noted that 
the order of these limits can be significant. That an interchange of such limits can lead to a new 
thermodynamic picture of the spin glass phase does not seem to have been appreciated prior to [79|. 

Based on these considerations, a new, nonstandard interpretation of the mean-field RSB picture 
was introduced in iTT^ and described in detail in Sec. VII of [82]. It is a maximal mean-field pic- 
ture, preserving mean-field theory's main features, although in an unusual way. The most natural 
description of this nonstandard interpretation is in terms of the metastate. 

We now summarize, informally, the nonstandard SK picture. Formal treatments can be found 
in lfT5ll79l : other detailed descriptions appear in Il57ll73ll82l . 

We again consider the PBC metastate, although, as always, almost any other coupling-independent 
metastate will suffice. In order to resemble the structure of ordering in the SK model as closely as 
possible, the nonstandard SK picture assumes that in each A^., the finite- volume Gibbs state p j^ii 
is well approximated deep in the interior by a mixed thermodynamic state T^^^\ decomposable 
into many pure states pa^\ 

F(^^) = 5:<(i;,p.,^. (29) 

In this equation, explicit dependence on J is suppressed. F*^^'^ is a thermodynamic mixed state 
decomposable into pure states pa^_ ; the index Lj is meant only to indicate the volumes in which 
appears. 

Each mixed state F^^'^ is presumed to have a nontrivial overlap distribution 

PviL,= E (30) 

of the form shown in Fig. 5. Moreover, the distances among any three pure states within a partic- 
ular F are assumed to be ultrametric. 

As already noted, the presence of CSD requires that F*^^') change in some "chaotic" fashion 
with Li. Hence, if one computes the overlap distribution in a particular A^-, one would see some- 
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Figure 8: The overlap distribution, at fixed J , in two different volumes Ai and A2 in the nonstan- 
dard SK picture. 

thing like Fig. 5. However, if one looks at two typical volumes of very different sizes, one would 
see something like Fig. 8. 

7.4 What Non-Self-Averaging Really Means 

In this section we discuss why the nonstandard SK picture forces a redefinition of the meaning of 
non-self-averaging. An important consequence of this redefinition is that most quantities of interest 
can now be defined for a single realization of the disorder: this includes the overlap distribution 
function. So it is possible after all to focus on a particular sample rather than an ensemble of 
samples. 

The same argument, given in Sec. 17.21 that showed the translation-covariance of the thermody- 
namic state Pj{ct) applies equally to the metastate kj. As a consequence, the resulting ensemble of 
overlap distributions Pp{L,) is independent of J . The dependence of the overlap distribution on A^. 
(as r(-^») varies within the metastate ensemble), no matter how large Lj becomes, is the redefinition 
of non-self-averaging. It replaces dependence of overlap distributions on J with dependence on 
Li for fixed J . 

So, instead of averaging the overlap distribution over J , the averaging must now he done over 
the states F within the metastate k j, all at fixed J: 

P{q) = [PTiq)].j = I Priq)f^Ar)dT . (31) 

The P{q) thus obtained for a single J' has the form shown in Fig. 6, and is the same for a.e. J'. 
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7.5 Differences Between the Standard and Nonstandard Pictures 



The nonstandard SK picture differs from the usual one in several important respects. One is the 
lack of dependence of overlap distributions on J , and the replacement of the usual sort of non-self- 
averaging with that of dependence on states within the metastate. Another important difference 
is that, in the nonstandard SK picture, a continuum (and therefore, an uncountable infinity) of 
pure states and their overlaps must be present; therefore, ultrametricity would not hold in general 
among any three pure states chosen at fixed J, for the same reason ultrametricity breaks down 
in the standard SK picture ll86l . Instead, the pure states at fixed J are split up into a continuum 
of families, where each family consists of those pure states occurring in the decomposition of a 
particular F, and only within each such family would ultrametricity hold. 

This has an important zero-temperature implication, because there is no dijference between 
the standard and nonstandard SK pictures at T = 0. The reason is that, for any finite L and, 
say, periodic boundary conditions, there will be only a single ground state pair io-Q in A^. (We 
assume as usual that the coupling distribution is continuous, such as Gaussian, to avoid accidental 
degeneracies.) It follows that overlaps of ground states cannot display nontrivial ultrametricity, or 
any other nontrivial structure. 

We have presented the nonstandard SK picture as a replacement for the more standard mean- 
field picture; if realistic spin glasses display any mean-field features, something like it must occur. 
However, this leaves open the question of what does happen in realistic spin glasses. In particular, 
can the nonstandard SK picture actually occur in short-ranged spin glasses? In the next section we 
show that the answer, again, is no. 

7.6 Invariance of the Metastate 

In this section we present a theorem about the metastate whose proof is relatively simple but whose 
implications are powerful and far-reaching, not only for spin glasses but for disordered and inho- 
mogeneous systems in general. However, we restrict the discussion here to the EA model in any 
finite dimension and at any temperature, in zero field and with a symmetric coupling distribution. 
We consider again flip-related boundary conditions, such as periodic and antiperiodic, or any two 
fixed b.c.'s. 

Theorem 3 ll73l . Consider two metastates constructed along a deterministic sequence of A^'s, 
using two different sequences of flip-related, coupling-independent b.c.'s. Then with probability 
one, these two metastates are the same. 
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The proof, given in is relatively straightforward, and uses two ingredients. The first 
is that, as proved in ifTSll . along some deterministic subsequence of volumes both the histogram 
construction of metastates and the Aizenman-Wehr construction BSOI result in the same metastate. 
But because the latter method averages over couplings outside of each volume, it rigorously follows 
(exactly as in the proof of Theorem 2 in Sec . 15 ■2.4b that two metastates constructed with flip-related 
b.c.'s must be the same. 

Despite the straightforward nature of the theorem and proof, it is a striking result, and its 
consequences for the nature of the spin glass state are immediate. Not only are the periodic and 
antiperiodic metastates the same; if one were to choose, in a ^/-independent manner, two arbitrary 
sequences of periodic and antiperiodic b.c.'s, the metastates (with probability one) would still be 
identical. That is, the metastate, and corresponding overlap distributions constructed from it, at 
any fixed temperature and in any dimension are highly insensitive to boundary conditions. 

This invariance with respect to different sequences of periodic and antiperiodic b.c.'s means 
that the frequency of appearance of various thermodynamic states F*^^) in finite volumes A^^ is 
(with probability one) independent of the choice of boundary conditions. Moreover, this same 
invariance property holds (with probability one) among any two sequences affixed boundary con- 
ditions (and the fixed boundary condition of choice may even be allowed to vary arbitrarily along 
any single sequence of volumes)! It follows that, with respect to changes of boundary conditions, 
the metastate is extraordinarily robust. 

This insensitivity would be unsurprising if there were only a single thermodynamic state, such 
as paramagnetic, or a single pair of flip-related states, as in droplet/scaling. But it is difficult to see 
how our result can be reconciled with the presence of many thermodynamic states; indeed, at first 
glance it would appear to rule them out. 

However, while it does not rule out the possibility of many states. Theorem 3 does put severe 
constraints on the form of the metastate and its overlap distribution function. In light of this strong 
invariance property, any metastate constructed via coupling-independent b.c's should be able to 
support only a very simple overlap structure, effectively ruling out the nonstandard SK picture. 

The nonstandard SK picture requires (cf. Eq. (E^ ) that the F's appearing in the metastate be of 
the form Y.a W^r Pr' ^^^h the weights in each T nonzero and unequal. That implies that with 
periodic b.c.'s, say, the fraction of Lj's for which the finite volume Gibbs state in A^^ puts (e.g.) 
at least 84% of its weight in one pair of pure states is, say, 0.39. But then it must also be the case 
that with antiperiodic b.c.'s the fraction of volumes for which the finite volume Gibbs state puts at 
least 84% of its weight in some unspecified pair is still exactly 0.39! Moreover, the same argument 
must apply to any "cut" one might care to make; i.e., one constructs the periodic b.c. metastate and 
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finds that x% of all finite volumes have put y% of their weight in z states, with z depending on the 
(arbitrary) choice of x and y. Then this must be true also for all volumes with antiperiodic b.c's; 
and similarly (but possibly separately) among all pairs of fixed b.c. states. 

The only sensible way in which this could happen would be for the selection of states to be 
insensitive to the choice of boundary conditions, i.e., a particular sequence of b.c's should not 
prefer any states over any others, so that p j, the average over the metastate, would be some sort of 
uniform mixture of the pure states. However, this cannot happen when the F's are nontrivial mixed 
states, as in Eq. (l29b . 

The essential reason for this is that the weights in Eq. (l29b must change with J', as seen heuristi- 
cally by the following argument. Choose a particular coupling J,j.y and consider the transformation 
Jxy J'xy = Jxy + A J. Thcn thc weight of the pure state a within V will transform as 

W'' W"^ = r^W"/ J2 r^W^ (32) 

7 

where 

r„ = {exp^pAJcr^cTy))^ = cosh(/3AJ) + (cr^(jj^)„ sinh(/3AJ) , (33) 
for each pure state a. 

Now if each T has a nontrivial decomposition over many pure state pairs, as in Eq. (1^ . then the 
different pure state pairs differ in at least some even correlation functions; i.e., they have relative 
domain walls. Eqs. (l32b and (l33t would then lead to a change of the relative weights of the different 
pure state pairs. As a consequence, even a finite change in a single coupling J^y would change a 
uniform mixture (e.g., in the metastate average) to a non-uniform one. But, of course, the mixture 
must be the same for a.e. J. 

To summarize, the invariance of the metastate with respect to boundary conditions appears 
to be inconsistent with the transformation properties of F's of the form Eq. (l29t with respect to 
finite changes in J'. This leads to a contradiction, ruling out not only nonstandard SK but any 
picture in which the F's are a nontrivial mixture of pure states. When combined with our previous 
elimination of more standard versions of the mean field picture, it removes the possibility of any 
version of mean field ordering in short-ranged spin glasses. 

The invariance property of the metastate requires that both the pure state structure and the 
overlap structure of realistic spin glasses should be relatively simple. So what are the remain- 
ing, plausible possibilities for the structure of the spin glass phase? In the next section, we will 
introduce a new picture, guided once again by metastate concepts. 
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8 Structure of the Low-T Spin Glass Phase 



8.1 Remaining Possibilities 

Assuming that spin-flip symmetry is broken below some Tc{d) > 0, with d greater than some lower 
critical dimension d^, what then are the possible structures that the spin glass phase can assume? 

A two-state picture, in which the only observable pure states are global flips of each other, 
remains completely consistent with all rigorous results described in the preceding section. As 
noted in Sec.|3l the droplet/scaling scenario is such a two-state picture. At the same time, it should 
be emphasized that droplet/scaling makes additional assumptions that our results do not address. If 
it were to be proved that there exists only a single pair of pure states in the spin glass phase in any 
finite dimension above dc, this would lend strong support to droplet/scaling, but such a proof alone 
would not be sufficient to demonstrate its correctness. For fuller discussions of droplet/scaling, see 
[|43ll44ll45ll46ll?7ll48ll49l. 

Are there any many-state pictures that are consistent with the strong constraints imposed by 
the invariance of the metastate? There is such a picture, introduced by the authors in ll65l . and 
discussed in detail in |IT5l|571l23l|79l|82|. It is called the chaotic pairs picture, for reasons that will 
become apparent below. 

In a simple two-state picture like droplet/scaling, the overlap distribution function Pj{q) in 
a volume will simply approximate a sum of two ^-functions, as in Fig. 4, but with ±M^(T) 
replaced by ±qEA- In the chaotic pairs picture, each finite-volume Gibbs state pj will still be 
approximately a mixture of a single pair of spin-flip-related pure states, but now the pure state 
pair will vary chaotically with L. Then for each A^, Pj{q) will again approximate a sum of two 
5-functions at ±qEA- This picture is fully consistent with metastate invariance. 

So chaotic pairs resembles the droplet/scaling picture in finite volumes, but has a very different 
thermodynamic structure. It is a many-state picture, but unlike the mean-field picture, only a single 
pair of spin-reversed pure states p , pj^ , appears in a large volume A l with symmetric boundary 
conditions, such as periodic. In other words, for large L, one finds that 

p'j^^IpT + IpJ- (34) 

Here, the pure state pair (of the infinitely many present) appearing in finite volume A^ depends 
chaotically on L. Unlike the droplet/scaling picture, this new possibility exhibits CSD with peri- 
odic b.c.'s. So, like nonstandard SK, the periodic b.c. metastate is dispersed over (infinitely) many 
F's, but unlike nonstandard SK each F is a trivial mixture of the form T = T"' = ^pj + ^pj. The 
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overlap distribution for each T is the same: Pr = ^S{q — qea) + ^S{q + Qea)- It is interesting to 
note that the highly disordered spin glass model 112111221 l23l . mentioned in Sec. 12.1.11 appears to 
display just this behavior in its ground state structure in sufficiently high dimension. 

Why doesn't an argument similar to that used to rule out nonstandard SK also rule out chaotic 
pairs? Because in the chaotic pairs picture, as in droplet/scaling, there are in each T only two pure 
states (depending on T in chaotic pairs), each with weight 1/2. All even correlations are the same 
in any pair of flip-related pure states, so, by Eqs. (l32b and (l33l) . any change in couplings leaves the 
weights unchanged. 

There is an interesting additional piece of information that metastate invariance supplies for 
many-state pictures like chaotic pairs: the number of pure state pairs (if infinite) must be an un- 
countable infinity. If there were a countable infinity, one couldn't have a uniform distribution 
consisting of all equal, positive weights within the metastate. 

The term "chaotic pairs" was chosen in reference to spin- symmetric b.c.'s, such as periodic. If 
one considers a fixed b.c. metastate, then it would be more appropriate to refer to this picture as 
"chaotic pure states", because the Gibbs state in a typical large volume with fixed b.c.'s will be 
(approximately) a single pure state that varies chaotically with L. But the thermodynamic picture 
is the same, and just manifests itself slightly differently in different metastates. In particular, the 
average over the metastate p j (cf. Eq. (l28t ') should be the same for periodic and fixed b.c.'s. 

We conclude with a brief note about zero temperature, where we observed in Sec. 17.51 that in 
each Ai there is only a single ground state pair. If droplet/scaling holds, then this pair is the same 
for all large L; if infinitely many ground state pairs exist, then the pair changes chaotically with 
L. This will be true at T = for any many-state picture, whether chaotic pairs, mean-field RSB, 
or some other such picture. The metastates, hence overlap functions, of these many-state pictures 
differ only at positive temperature: the mean-field RSB picture at T > consists of the V in each 
volume exhibiting a nontrivial mixture of pure state pairs as in Eq. (1^ . while in chaotic pairs the F 
appearing in any A l consists of a single pure state pair, as in Eq. (l34l) . So the periodic b.c. metastate 
in the chaotic pairs picture looks similar at zero and nonzero temperatures, like droplet/scaling but 
unlike nonstandard SK. 

8.2 The Problem with P{q) 

In Sec. 17.31 we discussed the usual numerical procedure for constructing overlaps. In both chaotic 
pairs and droplet/scaling, the overlap distribution function in almost every large volume (computed 
in a window far from the boundaries, to avoid nonuniversal boundary effects) is simply a single 
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pair of ^-functions at -^Qea, as in Fig. 4. So using P{q) in the usual way cannot differentiate 
between a many-state picture like chaotic pairs and a two-state picture like droplet/scaling. 

One could try an alternative approach, such as looking at the average state over many volumes, 
as an approximation to studying the average over the metastate pj(cr). This average looks very 
different in the two pictures: in droplet/scaling, it is still a trivial mixture of two states, of the form 
Eq. (l34l) . while in chaotic pairs, it is presumably a uniform mixture over uncountably many states. 
This approach, in effect, takes the thermodynamic limit before breaking the replica symmetry, as 
discussed in Sec. 17.31 

Now there will be a difference between overlap functions in droplet/scaling and chaotic pairs. 
In droplet/scaling, Pj{q) is again a pair of (5-functions at ±qEA- In chaotic pairs, Pj{q) would now 
most likely equal 5{q): it was proven in ||9UI . and will be discussed in Sec. 111. 11 that Pj{q) = 6{q) 
for the spin overlaps of M-spin-flip-stable metastable states for any finite M. If there are infinitely 
many ground state pairs, we expect the same to be true for ground states, i.e., for M = oo. 
But, although there is now a difference between overlap functions in droplet/scaling and chaotic 
pairs, there is now also no difference between overlap functions in chaotic pairs and in the simple 
paramagnet! 

So, although the form of the overlap function can depend on how its computation is done, the 
overlap structure in spin glasses must be simple, regardless of whether there are infinitely many 
pure states or only a single pair. Moreover, the overlap function cannot distinguish between many 
states, and one or two states, in an unambiguous manner. 

Similar problems with overlap functions, in particular their sensitivity to boundary conditions 
for short-ranged systems, are discussed in ll47l . There it is noted that in the three-dimensional 
random field Ising model at low temperature and weak field magnitude, Pl(q') computed in a given 
Al will miss one of the relevant pure states. Conversely, in the two-dimensional Ising ferromagnet 
on a square lattice, at low temperature, and with antiperiodic b.c.'s in both directions, Piiq) gives 
the appearance of many states where there are only two. 

A final, interesting example was suggested to us by A. van Enter and appears in the Appendix 
of Consider Piiq) for an Ising antiferromagnet in two dimensions with periodic boundary 
conditions. For odd-sized squares Pl(q') is the same as that of the ferromagnet with periodic 
boundary conditions, and for even-sized squares it is equivalent to that of the ferromagnet with 
antiperiodic boundary conditions. The overlap distribution computed in the full volume therefore 
oscillates between two different answers, an example of CSD for overlap distributions. This illus- 
trates the importance of computing quantities in windows that are much smaller than the system 
size. In this case, restricting P{q) to such a window gives rise to a well-defined answer: a pair of 
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(5-f unctions. 



9 Interfaces 

Our discussion up to now has focused largely on the numbers and organization of pure states in the 
spin glass phase, if it exists. Even though these are fundamental constructs from the point of view 
of thermodynamics, and their multiplicity and organization directly affect observable equilibrium 
ll9l and dynamical ll9T1l spin glass properties, they may still seem somewhat abstract. In this section 
we will draw on recent results that provide a concrete link between the structure of interfaces on the 
one hand, and numbers of pure states, the relationships among them, and their low-lying excited 
states on the other. At the same time, we will extend and clarify our earlier distinction ("Sec. 15. 2. Tt 
between observable and invisible states. 

9.1 Space-Filling Interfaces and Observable States 

In Sec. 15.2.31 we introduced the notion of "space-filling" interfaces; these play a central role in 
what follows. The interface between two spin configurations and a'^ in is simply the set 
of couplings satisfied in one and not the other spin configuration; a domain wall is a connected 
component of an interface. So the interface between two configurations is the union of all domain 
walls, and may consist of one or many. We usually envision domain walls as lines or surfaces in 
the dual lattice, cutting those bonds satisfied in one but not the other spin configuration. Domain 
walls therefore separate regions (in the real lattice) in which spins in and a'^ agree from regions 
where they disagree. 

We will confine our remarks here to zero temperature, although it is possible to extend the dis- 
cussion to nonzero temperatures. We are interested only in interfaces whose linear spatial extent 
/ is 0{L) in Kl. At zero temperature, these are the only interfaces between ground state configu- 
rations, if the coupling distribution is continuous; that this is so follows from the same argument 
proving that domain walls separating infinite spin configurations cannot end in any finite region 
and cannot have closed loops ll53l . However, the restriction against closed loops need not apply to 
interfaces separating ground and excited states. 

If the number of couplings in an interface of linear extent I scales as we call dg the dimen- 
sion of the interface. A space-filling interface is one with ds = d. One of the interesting features of 
spin glasses is the possibility of ground or pure states separated by space-filling interfaces, unlike 
in ferromagnets where dg < d always. For example, the interface ground states generated from 
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Dobrushin boundary conditions (all boundary spins on one side of a plane bisecting fixed at +1 
and the remaining boundary spins —1) have a single domain wall relative to the uniform ground 
states, with dg = d — 1. 

The first result of this section is a theorem first proved in ll53ll indicating that interfaces sepa- 
rating observable ground states are space-filling. 

Theorem 4 ll55l . Suppose that in the EA model in some finite dimension d, there exists more 
than a single pair of thermodynamic ground states in a coupling-independent metastate. Then the 
interface between two ground states chosen from different pairs must have dg = d. 

Proof. We sketch the proof here for periodic boundary condition metastates; the extension 
to other coupling-independent metastates can be obtained using the procedure presented in [54|. 
Consider the periodic b.c. metastate kj. By taking two ground state pairs chosen randomly from 
Kj, one obtains a configuration of interfaces. This procedure yields a measure Vj on domain 
walls. By integrating out the couplings, one is left with a translation-invariant measure V on the 
domain wall configurations themselves. By the translation-invariance of V, any "geometrically 
defined event", e.g., that a bond belongs to a domain wall, either occurs nowhere or else occurs 
with strictly positive density. This immediately yields the result, o 

Remark. Theorem 4 extends to pure states at nonzero temperatures. 

9.2 Invisible States 

Our emphasis in this review has been on observable pure states, which we have identified as the 
'physical' states; that is, we expect only those states to influence outcomes of laboratory measure- 
ments or numerical simulations. Still, it may be interesting to consider also the characteristics of 
'invisible' states, should they be present. 

Recall that an invisible pure state is one that does not lie in the support of any coupling- 
independent metastate. Invisible pure states can only be generated by sequences of coupling- 
dependent boundary conditions. There is presently no known method for constructing such states, 
and it is not clear whether such constructions, if found, would be measurable (Sec. |51). Conse- 
quently, it is not presently known whether such states actually exist in spin glasses, or if they do, 
whether they would be of any interest other than mathematical. Nevertheless, if they should be 
found to exist, one can still make some predictions about their properties. 

From the discussion in Sec. 15.2.31 the interfaces between invisible states would necessarily 
have energies scaling as with 9 > (d — l)/2; any interface with lower energy would almost 
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certainly show up in a coupling-independent metastate. So a "high-energy" interface, satisfying 
the above condition, would separate invisible pure states from observable ones (or each other), 
regardless of the interface dimensionality ll92ll . 

It also follows, by Theorem 4, that any interface with dimension dg < d separating pure states 
would necessarily appear only from coupling-dependent boundary conditions. Such an interface 
would necessarily have high energy; if its energy exponent < (rf — l)/2, it would not correspond 
to an interface between invisible and observable pure states, but rather to one between excited and 
ground states. This is discussed further in Sec. 19.41 

9.3 Relation Between Interfaces and Pure States 

We conclude from the previous discussion that interfaces separating observable ground (or pure) 
states are both space-filling and have energies scaling as where < 6 < (d — l)/2. In (51) 
we proved the converse, namely that the existence of such interfaces is a sufficient condition for 
the existence of more than one thermodynamic pure state pair. Specifically, the presence of space- 
filling interfaces is already sufficient for the existence of multiple pure state pairs; the energy 
condition is necessary for the pure states to be observable. 

As noted in Sec. 15.2.31 RSB theory predicts that interfaces between ground states in (say, 
under a switch from periodic to antiperiodic boundary conditions) are both space-filling and have 
energies of 0(1) independent of lengthscale |l75ll26l|771l28l; i.e., they have exponent 6' = 0. By the 
above theorem, the space-filling property requires the existence of multiple thermodynamic pure 
states, and the 0(1) energy property implies that typical large A^'s with, say, periodic boundary 
conditions, would exhibit thermodynamic states that are nontrivial mixtures of different pure state 
pairs (see also fl73l ). But in Sec. l7.6l it was shown that such states cannot appear in the EA model. 
It follows that space-filling interfaces with 0(1) energy are ruled out. 

9.4 Low-Lying Excited States 

The discussion of the preceding two sections was restricted to pure or ground states. One can 
construct other types of metastates, such as "excitation metastates" | l54ll , whose support includes 
both ground and low-lying excited states. One example of an excitation metastate is the "uniform 
perturbation metastate" which we now describe. 

Once again, consider a deterministic sequence A^ of cubes with periodic boundary conditions; 
at zero temperature, each such cube has a single pair idg of ground states. For each L, consider a 
second spin configuration a'^, generated by some prespecified procedure (examples will be given 
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below). Then do for the pair (ctq , a'^) what was done for ctq in the original metastate; i.e., measure 
the relative frequency of occurrence of each pair (inside a fixed window, as always). The result- 
ing uniform perturbation metastate gives for both infinite- volume ground and excited states their 
relative frequency of appearance inside large volumes. 

The uniform perturbation metastate is useful when considering recent numerical studies iTTTl 
l78l l94l l95l on EA Ising spin glasses in three and four dimensions that may have uncovered new 
types of states. In each volume, their interface with the ground state has dg < d with an energy 
of 0(1), independently of lengthscale. (It should be noted that questions have been raised over 
the correct interpretation of these numerical results 117511961 . so we consider these states only as an 
interesting possibility.) Because the two new constructions that lead to these states are done in a 
translation-invariant manner, a simple extension of Theorem 4 to uniform perturbation metastates 
rules out the possibility that these new states can be ground or pure states; if they exist at all, 
they must be excited states. 

Although the two procedures are different, they seem to lead to similar outcomes. The Krzakala- 
Martin iTTSI procedure forces a random pair of spins (cr^, cr^/) to assume a relative orientation op- 
posite to that in the ground state pair icTg ; the rest of the spins are then allowed to relax to the 
available lowest-energy configuration. This ensures that at least some bonds in the excited spin 
configuration, a'^, must be changed (i.e., satisfied ^ unsatisfied) from ctq . It also ensures that the 
energy of a'^ is no more than 0(1) above that of ctq , regardless of L. In the Palassini- Young |77| 
procedure, a novel coupling-dependent bulk perturbation Hpy is added to the Hamiltonian © in 
Al, where 

HpY = (e/Nb) i^oU('o)y(^x(^y , (35) 

<x,y>eAL 

e is independent of L, and A^";, is the number of bonds < x, y > in A^. So here too the energy of 
a'^ is no more than 0(1) above that of a^. 

Krzakala-Martin and Palassini- Young excitations have dg < d and = 0. In the two- state 
droplet picture of Fisher and Huse, however, excitations have dg < d and Q < < {d — 1) /2. One 
focus of current research is to determine which, if either, of these pictures holds in realistic spin 
glasses. 

To summarize, spin configurations with space-filling interfaces correspond to new ground or 
pure states, observable if their energy exponent < (c? — l)/2 and invisible if > {d—\)/2. If the 
"space-filling" exponent dg < d, then the corresponding configurations could correspond to new 
ground or pure states only if > {d — l)/2. If dg < d and 9 < (d — l)/2, such states can only be 
excitations and do not signify the presence of additional pure states (for further discussion. 
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see Sec. llO.l.ll below'). 



10 Summary and Discussion 

In this section we provide a brief summary of our conclusions and discuss how they tie in to various 
other approaches. 

10.1 Summary 

The central theme of this review is that a new set of concepts and methods are needed in the 
treatment of statistical models with both disorder and frustration. While we have mostly focused 
on the strong disconnect between infinite- and short-ranged spin glass models, we emphasize that 
this conclusion essentially results from an application — although a very important one — of our 
ideas and techniques. These results should be viewed as part of a more extensive and general 
framework for approaching the study of disordered systems. The unifying concept is that of the 
metastate (Sec.|6l), which broadens the focus of study from the conventional one of thermodynamic 
states, to distributions (or probability measures) on thermodynamic states — i.e., ensembles of 
thermodynamic states. Within this framework, universal themes that clarify the study of disordered 
systems can be considered: the detectability of many states, chaotic size dependence, the relations 
between interface types and pure states, 'windows' in numerical experiments, and others. 

As noted, a prominent application of these methods leads to the conclusion that the spin glass 
differs from most other statistical mechanical systems in that its infinite-ranged version displays 
unique low-temperature properties, not shared by corresponding short-ranged models in any di- 
mension and at any temperature (for other differences between homogeneous and disordered sys- 
tems in general, see Sec. II 1.21) . A likely underlying cause of this difference is the combination 
of the following features in the infinite-ranged spin glass: the presence of both ferromagnetic and 
antiferromagnetic couplings, the statistical independence of all of the couplings, and the scaling of 
their magnitudes to zero as ^ oo (cf. ll66l and Sec. 15.1.11) . The simultaneous presence of all 
three of these properties seems essential. In other systems (for example, a number of combinatorial 
optimization problems) with analogous features, one should expect similar behavior. 

In the following subsections, we expand upon these remarks. We begin by clarifying some 
essential issues. Although the contents of the following two subsections can be placed naturally 
into Sections l4~T] and [7!2l respectively, the issues they treat have generated sufficient confusion that 
it seems worthwhile to address them separately. 
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10.1.1 Are the Pure States We Discuss the 'Usual' Ones? 

The spin glass literature is replete with well-defined terms like 'pure state' used in imprecise ways, 
and often interchangeably with other terms such as 'valley'. A careful discussion has been given 
in ll^ni, to which we refer the reader. We note that the definition of pure states given in Sec. 14.11 
does in fact correspond, at least on a heuristic level, to the intuitive notion of 'valley' as a col- 
lection of configurations separated from all other configurations by barriers that diverge in the 
thermodynamic limit. 

This last statement can be made more precise, as in II6OII . by considering a specific dynamics; in 
our case, the dynamics could be the lattice animal M-spin-flip dynamics discussed in Sec. ll l.lJl 
for any finite M. Then a pure state may be thought of as a collection of configurations that can be 
reached from each other via the dynamics in finite time. At a given dimension and temperature, 
there may be only a single pure state or multiple, disjoint pure states. 

For an A^-spin system, with A^ finite, it is often useful to think of spin configurations as be- 
longing to different 'pure states' if the dynamical pathway (here it is necessary that M <^ N) 
connecting them requires a time that scales as the exponent of A^ to some power (see, for example, 
ll97l ). This notion has been highly successful in constructing dynamics-based solutions to the SK 
model 03 113 El- 

10.1.2 Is the Pj{q) Used to Rule Out the Standard SK Picture the 'Correct' One? 

There are two natural objections that are sometimes raised to the conclusion of ll86l . in which 
the standard SK picture is ruled out (see, for example, |98|). The specific overlap distributions 
constructed in ll86ll and described above involve certain types of averaging, for example, over 
lengthscale for fixed JT". Are these in fact different from the Pj{q) described by RSB theory, or 
studied in numerical experiments? Moreover, might it not be that the averaging process used in 
lIS^ is itself the cause of the self-averaged nature of the resultant Pj{q)^ 

The answer to these objections appears in ll^ . The first point is that, because of chaotic size 
dependence, the presence of many states probably forbids the construction of any (infinite- volume) 
Pj{q) with the following two properties: (i) the construction can be defined for a.e. J' (necessary if 
any sort of averaging over coupling realizations is to make sense), and (ii) the construction entails 
no averaging of any kind. So, for example, the construction proposed in [98 1, where Pj{q) is first 
defined for finite L, followed by taking a straightforward L ^ 00 limit, cannot work — there is no 
limiting Pj{q) for this construction (if there are many states). 

However, even if there were a construction with the above two properties, the conclusion would 
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be unchanged, because how Pj{q) is constructed is irrelevant — there cannot exist any Pj{q) 
which is both a physical infinite volume object and which is non-self-averaging. In fact, the only 
way out would be to construct a clearly unphysical Pj{q) that depends on the choice of origin of 
the coordinate system. This is an immediate (and rigorous) consequence of the spatial ergodicity 
of the underlying disorder distribution, as explained in ll86ll . 

10.2 Comparison to Other Work 

Our conclusions regarding the disconnect between the SK and EA models are supported by rigor- 
ous results. Nevertheless, there have been numerous studies that claim to support the basic features 
of the replica symmetry breaking, mean-field pure state structure in EA models in finite dimen- 
sions. In this section we discuss some of these studies and examine how they can be reconciled 
with the theorems reviewed above. Given the large number of such studies, we confine ourselves to 
a small but representative sample. For conciseness' sake, we will not review studies that claim to 
support pictures that are consistent with our results 11001 . such as droplet/scaling. (We emphasize 
once again, however, that our results make no claim about the correctness of droplet/scaling, and 
are equally compatible with some other competing pictures.) 

10.2.1 Numerical Studies 

There have been numerous simulations of the EA model, mostly in three and four dimensions, 
that claim to find results consistent with the RSB picture. We will restrict ourselves here to those 
studies that examine equilibrium properties. The number of such studies is still quite large, and 
even with this restriction, we will not attempt to cover them all here; an extensive review is given 
in im. A reasonably representative sample is given by ll42ll8TlfTMfT02lfT(MfT04ll . 

Most of these studies directly measure the spin overlap P{q) (and in some cases, also edge 
overlaps) for relatively small samples, and generally at temperatures that are not too low. Some 
problems associated with using P{q) have already been discussed in Sec. 18. 21 At least as important, 
most of these studies measure the overlap in the full volume under consideration, rather than in 
a much smaller 'window'. But as noted in Sec. 15.2.21 boundary effects — especially on these 
relatively small samples — will almost certainly dominate, so that no reliable conclusions can be 
drawn about whether one is really "seeing" the pure state structure. An illuminating example of 
how false conclusions can be drawn in such a case is given in Sec. VI of ll73l . 

A further problem concerns the temperature at which many of these studies is carried out. As 
discussed in Sec. 5 of ll57l . thermal effects can contribute heavily to nontrivial structure in either 
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spin or edge overlaps, and can therefore also lead to misleading conclusions. Some suggestions 
for overcoming these problems were presented in lISTI . 

Given all of these issues, it is unclear exactly what is actually being measured in these simula- 
tions, and extreme caution needs to be exercised before any conclusions addressing the relevance 
of RSB to short-ranged systems can be drawn from these studies. 

10.2.2 Analytical Studies 

There have been comparatively few analytical studies that try to extend directly the RSB picture 
to short-ranged spin glass models. An early attempt examined the averaged free energy in a l/rf 
expansion about d = oo II105I . and found thermodynamics consistent with those of the SK model. 
Near the critical temperature, an enhancement of RSB effects was found. 

A related but more detailed study was done by DeDominicis, Kondor, and Temesvari 11061 
who used a field-theoretical approach to extend the RSB theory to short-ranged models via a one- 
loop expansion. Here, the expansion was done (at fixed dimension d) inl/z about 2; = oo, where 
z is the coordination number. Above six dimensions, the leading mean-field term does not appear 
to be significantly modified by the loop corrections. 

While an interpretation of the 1 /rf or 1/z expansion results that supports the standard SK pic- 
ture is ruled out by our own results, these calculations may nevertheless indicate interesting be- 
havior. It should first be noted, though, that the calculations, though extensive, involve a number 
of uncontrolled approximations that need to be understood before any conclusions can be reached. 
One issue to resolve is the validity of an expansion done about a singular solution (d = 00 for 
simple nearest-neighbor hypercubic lattices in [il05il . and 2; = 00 at fixed dimension d in II106I '). 
It is also unclear what would happen if one went to higher orders in perturbation theory, and even 
whether these series converge. 

Another interesting possibility was raised by M.A. Moore II107I . who noted that the standard 
RSB approach expands about only one of the saddles of the mean-field solution. However, experi- 
ence with other systems (the disordered ferromagnet treated using replica methods 11081 . and the 
randomly diluted ferromagnet treated using non-replica methods llT09i ) implies that one may need 
to consider all saddle points, including nominally sub-dominant ones, to get the correct result. 

10.2.3 Renormalization Group Studies and Types of Chaoticity 

Our emphasis on the centrality of the connection between chaotic size dependence and the pres- 
ence of many states leads naturally to questions regarding whether our result is connected in some 
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way to the presence of other types of chaos that have been encountered in earlier spin glass stud- 
ies. One well-known example arose from studies llllOllllll of Migdal-Kadanoff renormalization- 
group transformations on frustrated Ising systems on hierarchical lattices. In these studies, chaotic 
renormalization-group trajectories were observed, possibly suggesting a type of spin glass-like be- 
havior. The specific behavior uncovered was a chaotic sequence of alternating strong and weak 
spin-spin correlations as distance increased. 

We suspect that the this behavior, if it carries over to spin glasses on Euclidean lattices, arises 
from different physical origins than those giving rise to chaotic size dependence. Roughly speak- 
ing, the renormalization-group studies of HllOl llllll uncover how correlation strengths change as 
one looks at spins increasingly farther apart. In contrast, chaotic size dependence focuses on a fixed 
correlation function, for example (aQai), calculated for each using an ordinary Gibbs measure 
with, say, periodic boundary conditions. If (o"oO"i) changes chaotically as L grows, a clear signal 
for many pure states is provided. If it does not, then the system likely has no more than a single 
pair of pure states. 

We're not aware of any studies attempting to correlate the presence of many states with changes 
in {cTxCy) as \x — y \ increases, as in HllOlllUl . but we suspect that such chaoticity may be present 
regardless of the multiplicity of pure states. 

Another type of chaoticity in spin glasses is chaotic temperature dependence (CTD). This has 
been the subject of numerous studies, and again can be detected using Migdal-Kadanoff renormal- 
ization group techniques II112II . Roughly speaking, temperature chaos refers to the erratic behavior 
of correlations, upon changing temperature, on lengthscales that diverge as the temperature in- 
crement goes to zero. It was predicted P31 l49l II 1211 for the EA spin glass as a consequence of 
the scaling/droplet ansatz, but seemed to be implied as well by the RSB theory Illl31lll4llll5l . 
More recent numerical and analytical work (see II116II and references therein) have led to claims 
that chaotic temperature dependence is not present in either the SK or the EA model (see also 
Hini ). although 11181 allows the possibility of a weak effect at large lattice sizes. Other work 
HI 191 claims to see a very small effect at ninth order in perturbation theory. At this time the issue 
remains unresolved. 

Chaotic temperature dependence and chaotic size dependence are clearly different, given that 
the latter is seen dX fixed temperature. Nevertheless, the intriguing question arises: are the two 
somehow related? We do not know the answer at this time. It seems at least plausible that a 
chaotic change in a fixed correlation function as the volume increases (CSD) would imply a simi- 
lar chaoticity as temperature changes (CTD), given that the former corresponds to surface changes 
and the latter to bulk changes. On the other hand, chaotic size dependence only occurs (for, say. 
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periodic boundary conditions) when there exist many competing pure states, and is absent for a 
single pair, as in droplet/scaling. At the same time, the droplet/scaling picture seems to require 
chaotic temperature dependence, which arises there from a lack of 'rigidity' (compared to a fer- 
romagnet) in the spin glass phase. So at the very least, chaotic temperature dependence does not 
seem to imply chaotic size dependence. Whether the converse is true remains an open question. 

10.3 Effects of a Magnetic Field 

In Sec. 12.21 the stability analysis of deAlmeida and Thouless ll27ll was discussed. Although the 
original intent was to study the stability of the replica-symmetric SK solution ll25ll in the T-h 
plane, the consequences of the analysis of ll27ll remain important for short-ranged models as well. 
In particular, the phase separation boundary between the paramagnetic and spin glass phases in the 
T-h plane is now generically referred to as an "AT" line, and debate over its existence for realistic 
spin glasses remains strong. In the RSB picture, the AT line begins at (Tc, 0) and extends upward 
through nonzero values of h (see, for example. Fig. 48 of In contrast, the droplet/scaling 
model predicts that the spin glass phase is unstable to any external magnetic field, no matter so 
small, resulting in no AT line. 

However, in the droplet/scaling picture even a small magnetic field will have dramatic dynam- 
ical consequences. The droplet theory predicts a "magnetic correlation length" that diverges as 
an inverse power of the field as /i — > (the power itself being a function of the domain wall energy 
exponent 9 defined in Sec. 15. 2. 3t . The magnetic correlation length describes roughly the length- 
scale over which a field h will destroy local correlations in a spin glass phase. On this lengthscale, 
the characteristic relaxation time r^^ grows exponentially with Consequently, spin glass 

correlations can persist for unmeasurably long times in small fields. This makes it difficult to es- 
tablish for a real spin glass sample whether a true thermodynamic AT line exists or whether one is 
instead observing a nonequilibrium dynamical effect. In the droplet/scaling picture, one therefore 
replaces the equilibrium AT line with a dynamical one, separating regions in the T-h plane where 
the system falls out of equilibrium on accessible laboratory time scales (cf. Fig. 3 in This 
feature, however, can create difficulties in the interpretation not only of laboratory experiments but 
also of numerical simulations (see, for example, II1201I121]| ). 

We turn now to our own results. We point out first that all of our theorems regarding self- 
averaging of overlaps, and therefore lack of viability of the RSB picture in short-ranged models, 
are not affected by addition of a magnetic field. However, our results do not rule out the presence 
of a true, thermodynamic AT line. In particular, the many-state chaotic pairs picture remains 
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perfectly consistent with the presence of such a line. Whether an AT line ultimately exists will 
almost certainly depend on the resolution of the problem of the number of states in zero external 
field: in all likelihood, there is no line if only a single pair of pure states exists, but it should be 
present if many states exist. 

11 Other Topics 
11.1 Metastable States 

Our analysis has focused largely on pure state structure and ordering in short-ranged spin glass 
models. While our emphasis has centered on equilibrium thermodynamics, we have argued else- 
where ll9n that pure states also deeply influence nonequilibrium dynamical phenomena, such as 
coarsening, aging, and others related to dynamical evolution following a deep quench. 

Another prominent, and much studied, feature of spin glasses is the presence of many metastable 
states, i.e., states that are energetically stable up to M-spin flips for some finite M, but unstable to 
flips of clusters of more than M spins. Colloquially speaking, these are spin configurations that are 
'local' rather than 'global' energy (or free energy, at positive temperature) minima; their confining 
barriers are of height 0(1) rather than 0{N^) for some 5 > 0. These states are believed to be 
responsible for much of the anomalously slow relaxation features of spin glasses II1221 11231 . and 
their presence has led to new numerical techniques such as simulated annealing II1241I1251I . 

In ll9m . we studied the properties of metastable states not only in EA spin glasses with contin- 
uous coupling distributions such as Gaussian, but also disordered ferromagnets. We will confine 
ourselves here to spin glasses, and will only present our own results; the reader is referred to |90| 
for a more detailed discussion, as well as references to other work on metastability. 

To clarify the discussion, we define a 1-spin-flip stable state as an infinite-volume spin con- 
figuration whose energy, as given by Eq. (|3l), cannot be lowered by the flip of any single spin. 
Similarly, an M-spin-flip stable state (M < oo) is an infinite-volume spin configuration whose 
energy cannot be lowered by the flip of any cluster of 1, 2, . . . , M spins. Recall (Sec. 14.11) that a 
ground state is an infinite-volume spin configuration whose energy cannot be lowered by the flip 
of any finite cluster of spins (i.e., M oo). 

11.1.1 A New Dynamical Method 

Our approach to studying metastable states is rather unusual, and based on a new dynamical tech- 
nique: we construct a natural ensemble (the "M-stable ensemble") on states that evolve from an 
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initial spin configuration generated through a deep quench via a zero-temperature "lattice animal" 
dynamics. 

We briefly describe this method, starting with the single-spin-flip case. Let cr° denote the ini- 
tial (time zero) infinite- volume spin configuration on Z'^. It is chosen from the infinite-temperature 
ensemble in which each spin is equally likely to be +1 or —1, independently of the others. The 
continuous-time dynamics is given by independent, rate-1 Poisson processes at each site x corre- 
sponding to those times t at which the spin at x looks at its neighbors and determines whether to 
flip. It does so only if a flip lowers the system energy (that is, we consider only zero-temperature 
dynamics). We denote by uji a given realization of this zero-temperature single-spin flip dynam- 
ics; so a given realization uji would then consist of a collection of random times j {x E Z'^, 
2 = 1, 2, . . .) at every x when spin flips for the spin are considered. 

Given the Hamiltonian © and a specific J7, cr°, and lui, a system will evolve towards a single 
well-defined spin configuration a* at time t (this uses the fact that the individual couplings come 
from a continuous distribution such as Gaussian). It is important to note that these three realizations 
(coupling, initial spin configuration, and dynamics) are chosen independently of one another. The 
continuous coupling distribution and zero-temperature dynamics together guarantee that the energy 
per spin E(t) is always a monotonically decreasing function of time. 

We now consider multiple-spin flips, in which we allow rigid flips of all lattice animals (i.e., 
finite connected subsets of Z'^, not necessarily containing the origin) up to size M. The case M = 1 
is the single-spin flip case just described; M = 2 corresponds to the case where both single-spin 
flips and rigid flips of all nearest-neighbor pairs of spins are allowed; and the case of general M 
corresponds to flips of 1-spin, 2-spin, 3-spin, . . . M-spin connected clusters. A specific realization 
of this M-spin-flip dynamics will be denoted ujm- 

There is a technical issue that needs to be addressed, because we wish the dynamics to remain 
sensible even in the limit M ^ oo. We require that the probability that any fixed spin considers a 
flip in a unit time interval remains of order one, uniformly in M. Such a choice would guarantee, 
for example, that the probability that a spin considers a flip in a time interval At vanishes as 
At 0, again uniformly in M. A further requirement for the dynamics to be well-defined is that 
information not propagate arbitrarily fast throughout the lattice as M becomes arbitrarily large. It 
is not difficult to construct such a dynamics, but we omit the technical details here; they can be 
found in L90J. 
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11.1.2 Results 



In this section we present some of the results found in we omit all proofs and detailed dis- 
cussions. Some of these results are expected, while others are surprising and at variance with the 
"folk wisdom" that has evolved over the years. Aside from the intrinsic interest in the structure 
of metastability in spin glasses, we believe that the information obtained also sheds light on some 
aspects of pure state structure, if only by way of contrast. All results given below are rigorous, and 
hold for a.e. J , cr°, and cum- 

Existence and Number of Metastable States. — In an infinite system, the Hamiltonian Q 
displays uncountably many M-spin-flip stable states, for all finite M > 1 and for all finite d > 1. 

Convergence of Dynamics Following a Deep Quench. — It is not obvious a priori whether the 
system evolves towards a single, final metastable state ct°°. It can be proved, however, that such a 
final state exists almost surely. Equivalently, every spin flips only finitely many times. (This is in 
contrast to, say, the 2D Ising ferromagnet, where every spin flips infinitely many times llOTl .) 

How Much Information is Contained in the Initial State? — For M = 1 in ID, precisely half 
the spins in a°° are completely determined by a^, with the other half completely undetermined by 
cr°. For higher d and the same dynamics, it can be shown that a dynamical order parameter qd, 
measuring the percentage dependence of a°° on cr°, is strictly between and 1. 

Size of Basins of Attraction — The basins of attraction of the individual metastable states are 
of negligible size, in the following sense: almost every is on a boundary between two or more 
metastable states. Equivalently, the union of the domains of attraction of all of the metastable 
states forms a set of measure zero, in the space of all cr^'s. (A similar result for pure states was 
proved in ||9T1 .) 

Distribution of Energy Densities. — For any M, almost every M-spin-flip stable state has the 
same energy density, Em- Moreover, the dynamics can be chosen so that Ei > E2 > > . . . , 
and furthermore Em for any finite M is larger than the ground state energy density, which is the 
limit of Em as M ^ 00. 

Overlaps. — Almost every pair of metastable states, whether two M-spin-flip stable states or one 
M- and one M'- spin-flip stable state, has zero spin overlap. So the overlap distribution function, 
for either all of the metastable states, or only all those with any fixed M, is simply a 5-function at 
zero. 

Scaling of Number of Metastable States with Volume. — For sufficiently large volumes, the 
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number of metastable states in finite samples scales exponentially with the volume in general d for 
states of any stability. 

Remanent Magnetization. — If the initial state is uniformly +1 in ID, the remanent magnetiza- 
tion is known to be 1/3 (for M = 1) II126II . In higher dimensions, a heuristic calculation for the 
Gaussian spin glass gives a rigorous lower bound on the remanent magnetization that for large d 
behaves like e~^'^'°§('^). Exact results can be obtained in all d for some other models ll90l . 

Correspondence Between Pure and Metastable States. — More precisely, if there are multiple 
pure or ground state pairs, does the spin configuration corresponding to a typical metastable state 
"live in" the domain of attraction of a single pure or ground state, as is commonly thought? The 
answer is no in both cases: almost every metastable state will be on a boundary in configuration 
space between multiple pure or ground states. 

Finally, we ask: does knowledge of metastable states provide information on the number or 
structure of thermodynamic ground or pure states? So far, the answer seems to be largely no. For 
example, in the one-dimensional spin glass there is only a single pair of thermodynamic ground 
states, but an uncountable number of infinite-volume M-spin-flip stable states for any finite M. 
This example illustrates a potential difficulty with numerical studies in higher dimensions, aimed 
at determining the number of ground or pure states: the presence of many metastable states could 
complicate interpretations of these studies. 

11.2 The Statistical Mechanics of Homogeneous vs. Disordered Systems 

Our hope is that this topical review has conveyed some of the depth and richness of the physics and 
mathematics of the equilibrium statistical mechanics of spin glasses. We conclude by returning 
briefly to Question 7, raised in Sec. |3l In what ways do we now understand how the statistical 
mechanical treatment of systems with quenched disorder differs in fundamental ways from that of 
homogeneous systems? In some sense, much of this review focused on one or another aspect of 
this question, but it may be helpful for us to tie together some of the common threads that have run 
through much of this review. We emphasize that we will not attempt to provide a comprehensive 
or even an extensive answer to this question, which remains largely open, but will only focus on 
some of the insights that our analysis of the spin glass problem may have uncovered. (A similar 
discussion appears also in II127I .') 

Most homogeneous systems that can be treated by classical equilibrium statistical mechanics 
share several salient features. Whether one is studying crystals, ferromagnets, ferroelectrics, liquid 
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crystals, or even some quantum systems such as superconductors and superfluids, the analysis 
of the low-temperature phase is simplified by various spatial symmetries, such as translational, 
orientational, gauge, and others. Of course, no such symmetries are manifestly apparent in many 
disordered systems. 

It has also been known for many years ifTSi that averaging over the quenched disorder presents 
additional complications. But this issue has been extensively discussed in many other reviews 
m [TOl [m [121 US US [T6| and will not be further addressed here. Another complicating feature 
present in some (but not all) disordered systems is frustration. While frustration may also occur in 
homogeneous systems (e.g., triangular antiferromagnets), its joint presence with quenched disorder 
may result in more profound effects. We hereafter confine ourselves to systems with both disorder 
and frustration, taking the spin glass as their prototype. 

The nature of the low-temperature phase is a clear point of departure between homogeneous 
systems and spin glasses (assuming they have a low-temperature phase). Homogeneous systems 
typically display a relatively simple order parameter, representing the nature of ordering in a pure 
or ground state that is unique up to an overall simple symmetry transformation that leaves the 
Hamiltonian invariant. It remains unknown whether the spin glass similarly possesses a simple 
order parameter in the EA model in finite dimensions, but it certainly does not in the infinite- 
ranged SK model. 

The striking contrast between the nature of broken symmetry in the RSB theory, as opposed to 
that present in most homogeneous systems, is clearly an important difference between them and 
infinite-ranged spin glasses. However, as extensively discussed in this review, it now appears that 
this type of broken symmetry is absent in short -ranged spin glass models. 

However, rather than seeing this as a disappointing piece of news, our viewpoint is that it is 
perhaps indicative of a far deeper contrast between spin glasses and simple homogeneous systems: 
in all such latter systems of which we are aware, mean field theory has been invaluable in providing 
the basic information concerning the nature of broken symmetry, order parameter(s), and low- 
temperature behavior in general. Mean field theory's main shortcoming lies in its behavior very 
close to the transition temperature, but even this failure usually occurs only in sufficiently low 
dimensions (which often includes the physically interesting case of 3Z)): there usually exists an 
upper critical dimension above which mean field theory also provides the correct critical exponents. 

If the infinite-ranged SK model becomes exact for the EA model in infinite dimensions, as 
is commonly believed, then we have a new feature whose contrast with homogeneous systems is 
perhaps even more striking than the presence of RSB: that is, the failure of mean field theory to 
provide a correct description of the low-temperature phase, even far from the critical point, in any 
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finite dimension. Equivalently, the d ^ oo limit of the EA model is singular. This possibility was 
broached by Fisher and Huse ll48ll . and our work confirms their conjecture. Some of the reasons 
why mean field theory fails in any finite dimension are presented in Sec. 15.11 and reviewed in 
Sec. Hon 

It is important to emphasize that the disconnect between the SK and EA models is profound 
ll66l : when one tries to transfer concepts in either direction, contradictory and even absurd results 
can ensue. One interesting question discussed in |66|, worth repeating here, is whether a new type 
of thermodynamic object in place of states may be appropriate for understanding the meaning of 
replica symmetry breaking in the SK model. The usual notions of states are local ones: that is, 
they describe the behavior of correlation functions (at fixed locations) and related quantities. These 
notions do not seem to work for the SK model. This suggests the intriguing possibility that a more 
global object might be constructible that would provide a more natural 'fit' for the SK model. We 
do not know whether this will turn out to be the case, but it is clear that if it does, such an object 
would be substantially different from the thermodynamic states that have been used up until now. 

A different issue concerns the nonexistence of a thermodynamic limit for states (or equiva- 
lently, correlations). This is manifested as chaotic size dependence, and occurs when coupling- 
independent boundary conditions are used and there exist many observable pure states. This is 
really a reflection of the lack of any spatial symmetries that allow one to choose boundary condi- 
tions, or an external symmetry-breaking field, that can lead to the existence of such a limit. 

One could, of course, artificially obtain chaotic size dependence even in a simple homogeneous 
ferromagnet below by, say, choosing random boundary conditions independently in each Aj^. 
But there one also knows how to choose boundary conditions to obtain a limiting pure state, in- 
cluding the interface states, whose analogues would be invisible pure states in spin glasses (Sec.|9l). 
The option of choosing boundary conditions that lead to a limiting pure state does not now exist 
for spin glasses if they possess many pure state pairs; and there may or may not be fundamental 
reasons preventing that option from ever becoming available. Regardless of whether it does, it 
remains interesting and useful that the presence of chaotic size dependence provides a clear signal 
of the existence of many states (Sec. 13). 

Besides chaotic size dependence, it has been speculated that spin glasses, both short-ranged 
and infinite-ranged, display chaotic temperature dependence, as discussed in Sec. 110.2.31 As in- 
dicated there, whether chaotic temperature dependence actually exists in spin glasses remains an 
open question. However, its potential presence in spin glasses represents a qualitatively new ther- 
modynamic feature of at least some types of disordered systems. 

A further contrast between homogeneous and disordered systems is provided by the presence 
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of observability vs. invisibility of different types of pure states. This is intimately interwoven 
with chaotic size dependence, and also with the nature of the interfaces separating these states; 
these interfaces can, in principle, be different from those seen in homogeneous systems (Sec. |9l). 
These issues all arise from the use of coupling-dependent vs. independent boundary conditions. 
No analogue for this distinction exists in homogeneous systems, but it is very possibly of basic 
importance in systems with quenched disorder 

Finally, we would like to emphasize that if this entire discussion has uncovered any funda- 
mental unifying principle, it is the set of ideas and techniques encapsulated in the construct of the 
metastate. It is our strong belief that any final understanding of the spin glass phase, and possibly 
that of other inhomogeneous systems, will make extensive use of this concept. 

Acknowledgments. We thank T. Rosenbaum for suggesting we write this review, and A. van En- 
ter and P. Contucci for useful remarks on the manuscript. We are also indebted to M.A. Moore for 
a number of illuminating comments and for pointing us towards several useful references. 

References 

[1] M.A. Ruderman and C. Kittel, Phys. Rev. 96, 99 (1954). 

[2] T. Kasuya, Prog. Theor. Phys. 16, 45 (1956). 

[3] K. Yosida, Phys. Rev. 106, 893 (1957). 

[4] H. Maletta and W. Felsch, Phys. Rev B 20, 1245 (1979). 

[5] For a recent review of quantum spin glasses, see R. Bhatt, in Spin Glasses and Random Fields, 
ed. A.R Young (World Scientific, Singapore, 1997), pp. 225 - 249, and references therein. 

[6] V. Cannella and J. A. Mydosh, Phys. Rev B 6, 4220 (1972). 

[7] J. A. Mydosh, in Heidelberg Colloquium on Glassy Dynamics, ed. J.L. van Hemmen and I. Morgenstern 
(Springer- Verlag, Berlin, 1987), pp. 24 - 39. 

[8] L.E. Wenger and RH. Keesom, Phys. Rev B 13, 4053 (1976). 

[9] K. Binder and A.R Young, Rev. Mod. Phys. 58, 801 (1986). 

[10] D. Chowdhury, Spin Glasses and Other Frustrated Systems (Wiley, NY, 1986). 

[11] K.H. Fischer and J.A. Hertz, Spin Glasses (Cambridge University Press, Cambridge, 1991). 

[12] J.R Bouchaud, L. Cugliandolo, J. Kurchan, and M. Mezard, in Spin Glasses and Random Fields, 
ed. A.R Young (World Scientific, Singapore, 1998), pp. 161-223. 



61 



[13] M. Mezard, G. Parisi, and M.A. Virasoro, Spin Glass Theory and Beyond (World Scientific, Singapore, 
1987). 

[14] D.L. Stein, in Lectures in the Sciences of Complexity, ed. D.L. Stein (Addison- Wesley, NY, 1989), pp. 
301-355. 

[15] CM. Newman and D.L. Stein, in Mathematics of Spin Glasses and Neural Networks, ed. A. Bovier 
and P. Picco (Birkhauser, Boston, 1997), pp. 243-287. 

[16] V. Dotsenko, Introduction to the Replica Theory of Disordered Statistical Systems (Cambridge Univer- 
sity Press, Cambridge, 2001). 

[17] S. Edwards and P.W Anderson, J. Phys. F 5, 965 (1975). 

[18] R. Brout, Phys. Rev. 115, 824 (1959). 

[19] G. Toulouse, Commun. Phys. 2, 115 (1977). 

[20] P.W. Anderson, J. Less-Common Metals 62, 291 (1978). 

[21] CM. Newman and D.L. Stein, Phys. Rev. Lett. 72, 2286 (1994). 

[22] CM. Newman and D.L. Stein, J. Stat Phys. 82, 1 1 13 (1996). 

[23] J.R. Banavar, M. Cieplak, A. Maritan, Phys. Rev. Lett. 11, 2320 (1994). 

[24] B. Derrida, Phys. Rep. 67, 29 (1980). 

[25] D. Sherrington and S. Kirkpatrick, Phys. Rev Lett. 35, 1792 (1975). 

[26] D.J. Thouless, PW. Anderson, and R.J. Palmer, Phil. Mag. 35, 593 (1977). 

[27] J.R.L. de Almeida and D.J. Thouless, /. Phys. A 11, 983 (1978). 

[28] G. Parisi, Phys. Rev Lett. 43, 1754 (1979). 

[29] G. Parisi, Phys. Rev Lett. 50, 1946 (1983). 

[30] M. Mezard, G. Parisi, N. Sourlas, G. Toulouse, and M. Virasoro, Phys. Rev. Lett 52, 1156 (1984). 

[31] M. Mezard, G. Parisi, N. Sourlas, G. Toulouse, and M. Virasoro, J. Phys. (Paris) 45, 843 (1984). 

[32] H. Sompolinsky and A. Zippelius, Phys. Rev Lett. 47, 359 (1981). 

[33] H. Sompolinsky, Phys. Rev Lett 47, 935 (1981). 

[34] H. Sompolinsky and A. Zippehus, Phys. Rev. B 25, 6860 (1982). 

[35] R. Rammal, G. Toulouse, and M.A. Virasoro, Rev Mod. Phys. 58, 765 (1986). 

[36] A.J. Bray and M.A. Moore, J. Phys. C 13, L469 (1980). 

[37] M.E. Fisher and R.R.P. Singh, in Disorder in Physical Systems, edited by G. Grimmett and 
D.J.A. Welsh (Clarendon Press, Oxford, 1990), pp. 87-111. 

62 



[38] MJ. Thill and H.J. Hilhorst, J. Phys. 16, 67 (1996). 

[39] A.T. Ogielski, Phys. Rev. B 32, 7384 (1985). 

[40] A.T. Ogielski and 1. Morgenstem, Phys. Rev. Lett. 54, 928 (1985). 

[41] N. Kawashima and A.P. Young, Phys. Rev. B 53, R484 (1996). 

[42] E. Marinari, G. Parisi, and F. Ritort, J. Phys. A 27, 2687 (1994). 

[43] W.L. McMillan, /. Phys. C 17, 3179 (1984). 

[44] A.J. Bray and M.A. Moore, Phys. Rev B 31, 631 (1985). 

[45] A.J. Bray and M.A. Moore, Phys. Rev Lett. 58, 57 (1987). 

[46] D.S. Fisher and D.A. Huse, Phys. Rev Lett. 56, 1601 (1986). 

[47] D.A. Huse and D.S. Fisher, J. Phys. A 20, L997 (1987). 

[48] D.S. Fisher and D.A. Huse, J. Phys. A 20, L1005 (1987). 

[49] D.S. Fisher and D.A. Huse, Phys. Rev B 38, 386 (1988). 

[50] A.A. Middleton, Phys. Rev. Lett. 83, 1672 (1999). 

[51] M. Palassini and A.P Young, Phys. Rev B 60, R9919 (1999). 

[52] A.K. Hartmann, Eur. Phys. J. B 13, 539 (2000). 

[53] CM. Newman and D.L. Stein, Phys. Rev Lett. 84, 3966 (2000). 

[54] CM. Newman and D.L. Stein, Commun. Math. Phys. 224, 205 (2001). 

[55] M. Palassini and A.P Young, Phys. Rev Lett. 83, 5126 (1999). 

[56] E. Marinari and G. Parisi, Phys. Rev B 62, 1 1677 (2000). 

[57] CM. Newman and D.L. Stein, J. Stat. Phys. 106, 213 (2002). 

[58] Infinite- volume Gibbs measures p j^t can also be characterized independently of any limiting process, 
as probability measures on infinite-volume spin configurations that satisfy the Dobrushin-Lanford- 
Ruelle (DLR) equations. For a mathematically detailed presentation, see H.O. Georgii, Gibbs Mea- 
sures and Phase Transitions (de Gruyter Studies in Mathematics, Berlin, 1988). 

[59] The term 'ground state' is also sometimes used more broadly, to denote measures on multiple ground 
state configurations. In this review, we avoid this terminology, and use the term 'ground state' to refer 
only to a single, infinite-volume, spin configuration with the properties described above. 

[60] A.C.D. van Enter and J.L. van Hemmen, Phys. Rev. A 29, 355 (1984). 

[61] A.P Young, Phys. Rev Lett. 51, 1206 (1983). 



63 



[62] An interesting example of a nonrandom system with an ultrametric ground state structure is discussed 
in A.C.D. van Enter, A. Hof, and J. Mi^kisz, J. Phys. A 25, LI 133 (1992). 

[63] R.G. Palmer, Adv. Phys. 31, 669 (1982). 

[64] R.G. Palmer and D.L. Stein, in Relaxations in Complex Systems, eds. K.L. Ngai and G.B. Wright (U.S. 
Government Printing Office, Washington DC 1985^61-700/20001, 1985), pp. 253-259. 

[65] CM. Newman and D.L. Stein, Phys. Rev. B 46, 973 (1992). 

[66] C.M. Newman and D.L. Stein, "Nonrealistic Behavior of Mean Field Spin Glasses", available as 
cond-mat/0301202 

[67] M. Aizenman, J. Lebowitz, and D. Ruelle, Commun. Math. Phys. Ill, 3 (1987). 

[68] L. Pastur and M. Shcherbina, / Stat. Phys. 62, 1 (1991). 

[69] F. Guerra and F.L. TonineUi, Commun. Math. Phys. 230, 71 (2002). 

[70] W. Feller, An Introduction to Probability Theory and Its Applications, Vol. II (Wiley, NY, 197 1), p. 124. 

[71] See also the discussion in Sec. 3 of A.C.D. van Enter and J. Frohlich, Commun. Math. Phys. 98, 425 
(1985). 

[72] An example of nonphysical behavior arising from the use of coupling-dependent boundary conditions 
can be found in A. Gandolfi, C.M. Newman, and D.L. Stein, Commun. Math. Phys. 157, 371 (1993). 

[73] C.M. Newman and D.L. Stein, Phys. Rev E 57, 1356 (1998). 

[74] M. Aizenman and D.S. Fisher, unpubhshed (1991). 

[75] E. Marinari and G. Parisi, Phys. Rev B 62, 11677 (2000). 

[76] E. Marinari and G. Parisi, Phys. Rev Lett. 86, 3887 (2001). 

[77] M. Palassini and A.P Young, Phys. Rev Lett. 85, 3017 (2000). 

[78] F. Krzakala and O.C. Martin, Phys. Rev Lett. 85, 3013 (2000). 

[79] C.M. Newman and D.L. Stein, Phys. Rev Lett. 76, 4821 (1996). 

[80] M. Aizenman and J. Wehr, Commun. Math. Phys. 130, 489 (1990). 

[8 1] E. Marinari, G. Parisi, and J.J. Ruiz-Lorenzo, in Spin Glasses and Random Fields, edited by A.P. Young 
(World Scientific, Singapore, 1997), pp. 59-98. 

[82] C.M. Newman and D.L. Stein, Phys. Rev E 55, 5194 (1997). 

[83] See, for example, M.G. Nadkami, Basic Ergodic Theory (Birkhauser, Basel, 1998). 

[84] N. Wiener, Duke Math. J. 5, 1 (1939). 

[85] S. Franz, M. Mezard, G. Parisi, and L. Peliti, Phys. Rev. Lett. 81, 1758 (1998). 

64 



[86] CM. Newman and D.L. Stein, Phys. Rev. Lett. 76, 515 (1996). 
[87] CM. Newman and D.L. Stein, Phys. Rev. Lett. 84, 3966 (2000). 

[88] E. Marinari, G. Parisi, F. Ricci-Tersenghi, J.J. Ruiz-Lorenzo, and F. Zuliani, /. Stat. Phys. 98, 973 
(2000). 

[89] F. Guerra, private communication; see also Int. J. Mod. Phys. B 19, 1675 (1996). 
[90] CM. Newman and D.L. Stein, Phys. Rev E 60, 5244 (1999). 
[91] CM. Newman and D.L. Stein, J. Stat. Phys. 94, 709 (1999). 

[92] A very simple example, suggested to us by A. van Enter, of invisible states can be found in the Mat- 
tis site-disordered Ising model (D.C Mattis, Phys. Lett. A 56, 421 (1976)). After gauging away the 
randomness, one ends up with a ferromagnetic Ising model with random boundary conditions, whose 
interior state chaotically varies with volume between the positively and negatively magnetized states 
(A.C.D. van Enter, /. Stat. Phys. 60, 275 (1990)). While interface states exist in this model, just as in 
the ferromagnet, they are not seen when using boundary conditions not conditioned on the disorder 
realization. The free energy of an interface scales as L"^^^, while the free energy difference between, 
say, the uniformly plus and minus boundary conditions on the site-disordered system scales only as 
^('i-i)/2^ in accord with our discussion in the text. 

[93] CM. Newman and D.L. Stein, Phys. Rev Lett. 87, 077201 (2001). 

[94] J. Houdayer, F Krzakala, and O.C Martin, Eur. Phys. J. B 18, 467 (2000). 

[95] H.G. Katzgraber, M. Palassini, and A.P. Young, Phys. Rev B 63, 184422 (2001). 

[96] A.A. Middleton, Phys. Rev B 63, 060202(R) (2001). 

[97] N.D. Mackenzie and A.P Young, Phys. Rev Lett. 49, 301 (1982). 

[98] G. Parisi, unpublished. Available as lcond-mat/9603 1011 

[99] CM. Newman and D.L. Stein, unpubhshed. Available as adap-org/9603001J 

[100] See, for example, M.A. Moore, H. Bokil, and B. Drossel, Phys. Rev Lett. 81, 4252 (1998). 

[101] S. Caracciolo, G. Parisi, S. Patamello, and N. Sourlas, /. Phys. (Paris) 51, 1877 (1990). 

[102] J.D. Reger, R.N. Bhatt, and A.P Young, Phys. Rev Lett. 64, 1859 (1990). 

[103] E. Marinari, G. Parisi, J.J. Ruiz-Lorenzo, and F. Ritort, Phys. Rev Lett. 76, 843 (1996). 

[104] E. Marinari, G. Parisi, F. Ricci-Tersenghi, and J.J. Ruiz-Lorenzo, J. Phys. A 31, L481 (1998). 

[105] A. Georges, M. Mezard, and J. Yedidia, Phys. Rev Lett. 64, 2937 (1990). 

[106] See C. DeDominicis, I. Kondor, T. Temesvari, in Spin Glasses and Random Fields, edited by 
A.P. Young (World Scientific, Singapore, 1997), pp. 119-160 and references therein. 

[107] M.A. Moore, private communication. 



65 



[108] A.J. Bray, T.J. McCarthy, M.A. Moore, J.D. Reger, and A.P. Young, Phys. Rev. B 36, 2212 (1987). 
[109] A.J. McKane, Phys. Rev. B 49, 12003 (1994). 

[110] S.R. McKay, A.N. Berker, and S. Kirkpatrick, Phys. Rev Lett. 48, 767 (1982). 

[Ill] S.R. McKay and A.N. Berker, J. Appl. Phys. 55, 1646 (1984). 

[112] J.R. Banavar and A.J. Bray, Phys. Rev. B 35, 8888 (1987). 

[113] I. Kondor, J. Phys. A, Math. Gen. 22, L163 (1989). 

[114] M. Ney-Nifle and H.J. Hilhorst, Physica A 193, 48 (1993). 

[115] F. Ritort, Phys. Rev. B 50, 6844 (1994). 

[116] A. Billoire and E. Marinari, J. Phys. A, Math. Gen. 33, L265 (2000). 

[117] J-P Bouchaud, V. Dupuis, J. Hammann, and E. Vincent, Phys. Rev. B 65, 024439 (2002). 

[118] A. Billoire and E. Marinari, lcond-mat/02024731 

[119] T. Rizzo and A. Crisanti. lcond^mat/02093331 

[120] R.R.P Singh and D.A. Huse, /. Appl. Phys. 69, 5225 (1991). 

[121] E.R. Grannan and R.E. Hetzel, Phys. Rev Lett. 67, 907 (1991). 

[122] C. Dasgupta, S.-K. Ma, and C.-K. Hu, Phys. Rev. B 20, 3837 (1979). 

[123] See, for example, K. Binder and W. Kinzel, in J.L. van Hemmen and I. Morgenstem, eds. Heidel- 
berg Colloquium on Spin Glasses (Springer- Verlag, Berlin, 1983), pp. 279 - 304; I. Morgensetern, in 
J.L. van Hemmen and I. Morgenstern, ibid., pp. 305 - 327; and A.P. Young, in J.L. van Hemmen and 
I. Morgenstem, ibid., pp. 328 - 345. 

[124] S. Kirkpatrick, CD. Gelatt, and M.P Vecchi, Science 220, 671 (1983). 

[125] V. Cerriy, J. Optim. Theory Appl. 45, 41 (1985). 

[126] J.F Fernandez and R. Medina, Phys. Rev. B 19, 3561 (1979). 

[127] D.L. Stein, "Spin Glasses: Still Complex After All These Years?", to appear in Quantum Decoherence 
and Entropy in Complex Systems, ed. H.-T. Elze (Springer). 



66 



